-- Logs begin at Thu 2021-11-25 13:59:40 UTC, end at Thu 2021-11-25 16:44:57 UTC. -- Nov 25 14:38:43.216943 n-d-819181-1 systemd[1]: Started Devstack devstack@n-super-cond.service. Nov 25 14:38:46.515905 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_db.sqlalchemy.engines [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 25 14:38:46.740745 n-d-819181-1 nova-conductor[88954]: DEBUG nova.context [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) {{(pid=88954) load_cells /opt/stack/nova/nova/context.py:465}} Nov 25 14:38:46.744865 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_concurrency.lockutils [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:38:46.746607 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_concurrency.lockutils [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:38:46.747509 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_concurrency.lockutils [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:38:46.749580 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_concurrency.lockutils [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:38:46.782502 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_db.sqlalchemy.engines [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 25 14:38:46.783380 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_db.sqlalchemy.engines [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 25 14:38:46.797164 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_concurrency.lockutils [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Acquired lock "singleton_lock" {{(pid=88954) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 25 14:38:46.797861 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_concurrency.lockutils [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Releasing lock "singleton_lock" {{(pid=88954) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 25 14:38:46.798838 n-d-819181-1 nova-conductor[88954]: INFO oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Starting 2 workers Nov 25 14:38:46.803454 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Started child 89840 {{(pid=88954) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Nov 25 14:38:46.808129 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Started child 89841 {{(pid=88954) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Nov 25 14:38:46.811418 n-d-819181-1 nova-conductor[89840]: INFO nova.service [-] Starting conductor node (version 22.3.1) Nov 25 14:38:46.812977 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Full set of CONF: {{(pid=88954) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Nov 25 14:38:46.813496 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ******************************************************************************** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 25 14:38:46.813955 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] Configuration options gathered from: {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 25 14:38:46.814457 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 25 14:38:46.815195 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] config files: ['/etc/nova/nova.conf'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 25 14:38:46.820325 n-d-819181-1 nova-conductor[89841]: INFO nova.service [-] Starting conductor node (version 22.3.1) Nov 25 14:38:46.821567 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ================================================================================ {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 25 14:38:46.822326 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] allow_resize_to_same_host = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.822814 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] arq_binding_timeout = 300 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.823269 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] bandwidth_poll_interval = 600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.823731 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] bindir = /usr/local/bin {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.824159 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] block_device_allocate_retries = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.824599 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] block_device_allocate_retries_interval = 3 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.825032 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cert = self.pem {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.825475 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute_driver = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.825976 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute_monitors = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.826447 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] config_dir = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.826894 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] config_drive_format = iso9660 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.827234 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.827681 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] config_source = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.828102 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] console_host = n-d-819181-1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.828537 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] control_exchange = nova {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.828958 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cpu_allocation_ratio = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.829384 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] daemon = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.829839 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] debug = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.830578 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] default_access_ip_network_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.830705 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] default_availability_zone = nova {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.831077 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] default_ephemeral_format = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.831674 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.845799 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] default_schedule_zone = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.846318 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] disk_allocation_ratio = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.846663 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] enable_new_services = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.847219 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] enabled_apis = ['osapi_compute'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.847552 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] enabled_ssl_apis = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.847993 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] flat_injected = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.849200 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] force_config_drive = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.849200 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] force_raw_images = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.849403 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] graceful_shutdown_timeout = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.849646 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] heal_instance_info_cache_interval = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.850058 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] host = n-d-819181-1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.850509 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.851068 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] initial_disk_allocation_ratio = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.851524 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] initial_ram_allocation_ratio = 1.5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.852088 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.852499 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] instance_build_timeout = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.852912 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] instance_delete_interval = 300 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.853352 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] instance_format = [instance: %(uuid)s] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.853757 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] instance_name_template = instance-%08x {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.854173 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] instance_usage_audit = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.854594 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] instance_usage_audit_period = month {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.855113 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.855452 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] instances_path = /opt/stack/data/nova/instances {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.856114 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] internal_service_availability_zone = internal {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.856500 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] key = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.856892 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] live_migration_retry_count = 30 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.858917 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] log_config_append = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.861043 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_db.sqlalchemy.engines [None req-0e16df90-c01e-4f60-9a29-c12d15040fcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 25 14:38:46.862223 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_db.sqlalchemy.engines [None req-fdd754c3-6184-4c03-8d64-b960fa8270cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 25 14:38:46.869569 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.870208 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] log_dir = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.870771 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] log_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.871585 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] log_options = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.872317 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] log_rotate_interval = 1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.874314 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] log_rotate_interval_type = days {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.874922 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] log_rotation_type = none {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.875417 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.876756 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.879472 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.880069 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.880562 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.881175 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] long_rpc_timeout = 1800 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.882972 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] max_concurrent_builds = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.885185 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] max_concurrent_live_migrations = 1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.885893 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] max_concurrent_snapshots = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.888542 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] max_local_block_devices = 3 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.889413 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] max_logfile_count = 30 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.890165 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] max_logfile_size_mb = 200 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.890990 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] maximum_instance_delete_attempts = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.891714 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] metadata_listen = 0.0.0.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.892497 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] metadata_listen_port = 8775 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.893151 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] metadata_workers = 2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.893687 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] migrate_max_retries = -1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.894315 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] mkisofs_cmd = genisoimage {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.895170 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] my_block_storage_ip = 10.222.0.65 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.895668 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] my_ip = 10.222.0.65 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.896489 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] network_allocate_retries = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.897202 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.898515 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] osapi_compute_listen = 0.0.0.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.898771 n-d-819181-1 nova-conductor[89841]: DEBUG nova.service [None req-0e16df90-c01e-4f60-9a29-c12d15040fcd None None] Creating RPC server for service conductor {{(pid=89841) start /opt/stack/nova/nova/service.py:182}} Nov 25 14:38:46.899610 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] osapi_compute_listen_port = 8774 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.900159 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] osapi_compute_unique_server_name_scope = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.900746 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] osapi_compute_workers = 2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.901307 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] password_length = 12 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.902091 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] periodic_enable = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.902795 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] periodic_fuzzy_delay = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.903354 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] pointer_model = usbtablet {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.903945 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] preallocate_images = none {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.905004 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] publish_errors = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.905593 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] pybasedir = /opt/stack/nova {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.906547 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ram_allocation_ratio = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.907234 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] rate_limit_burst = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.907835 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] rate_limit_except_level = CRITICAL {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.908377 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] rate_limit_interval = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.908909 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] reboot_timeout = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.909808 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] reclaim_instance_interval = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.910380 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] record = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.910907 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] report_interval = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.911437 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] rescue_timeout = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.912488 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] reserved_host_cpus = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.913047 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] reserved_host_disk_mb = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.913693 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] reserved_host_memory_mb = 512 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.914277 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] reserved_huge_pages = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.914819 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] resize_confirm_window = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.915361 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] resize_fs_using_block_device = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.915898 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] resume_guests_state_on_host_boot = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.916711 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.917433 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] rpc_response_timeout = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.917961 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] run_external_periodic_tasks = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.918519 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] running_deleted_instance_action = reap {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.919752 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] running_deleted_instance_poll_interval = 1800 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.920343 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] running_deleted_instance_timeout = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.920875 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler_instance_sync_interval = 120 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.921454 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_down_time = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.922347 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] servicegroup_driver = db {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.923046 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] shelved_offload_time = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.923593 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] shelved_poll_interval = 3600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.924196 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] shutdown_timeout = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.924819 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] source_is_ipv6 = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.925476 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ssl_only = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.926396 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] state_path = /opt/stack/data/nova {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.927512 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] sync_power_state_interval = 600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.928063 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] sync_power_state_pool_size = 1000 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.928623 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] syslog_log_facility = LOG_USER {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.930318 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] tempdir = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.930874 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] timeout_nbd = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.931559 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] transport_url = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.932107 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] update_resources_interval = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.932929 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] use_cow_images = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.934124 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] use_eventlog = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.934690 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] use_journal = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.935320 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] use_json = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.935866 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] use_rootwrap_daemon = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.936851 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] use_stderr = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.937565 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] use_syslog = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.938087 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vcpu_pin_set = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.938625 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vif_plugging_is_fatal = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.939173 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vif_plugging_timeout = 300 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.939731 n-d-819181-1 nova-conductor[89840]: DEBUG nova.service [None req-fdd754c3-6184-4c03-8d64-b960fa8270cb None None] Creating RPC server for service conductor {{(pid=89840) start /opt/stack/nova/nova/service.py:182}} Nov 25 14:38:46.939897 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] virt_mkfs = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.940530 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] volume_usage_poll_interval = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.941058 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] watch_log_file = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.941641 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] web = /usr/share/spice-html5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 14:38:46.942304 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_concurrency.disable_process_locking = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.943143 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.943766 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.auth_strategy = keystone {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.944332 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.compute_link_prefix = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.945624 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.946189 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.dhcp_domain = novalocal {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.946869 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.enable_instance_password = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.947500 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.glance_link_prefix = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.948184 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.948743 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.949308 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.instance_list_per_project_cells = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.949983 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.list_records_by_skipping_down_cells = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.950650 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.local_metadata_per_cell = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.951217 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.max_limit = 1000 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.951748 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.metadata_cache_expiration = 15 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.952288 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.neutron_default_tenant_id = default {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.953115 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.use_forwarded_for = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.953658 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.use_neutron_default_nets = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.954276 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.954809 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.955353 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.955925 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.956490 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.vendordata_dynamic_targets = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.957232 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.vendordata_jsonfile_path = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.957804 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.958547 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.backend = dogpile.cache.memcached {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.959085 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.backend_argument = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.959633 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.config_prefix = cache.oslo {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.960185 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.debug_cache_backend = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.960837 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.enabled = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.961408 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.expiration_time = 600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.961944 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.memcache_dead_retry = 300 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.962479 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.963240 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.memcache_pool_maxsize = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.963775 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.964358 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.964898 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.memcache_socket_timeout = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.966506 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.proxies = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.969740 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.tls_allowed_ciphers = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.971866 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.tls_cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.972528 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.tls_certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.973362 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.tls_enabled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.973921 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cache.tls_keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.974522 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.auth_section = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.975083 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.auth_type = password {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.975759 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.976455 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.catalog_info = volumev3::publicURL {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.977000 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.977551 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.978103 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.cross_az_attach = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.978931 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.endpoint_template = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.979873 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.http_retries = 3 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.980486 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.981385 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.982207 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.os_region_name = RegionOne {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.982733 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.983555 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cinder.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.984094 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.984623 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute.cpu_dedicated_set = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.985176 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute.cpu_shared_set = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.985709 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.986690 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute.max_concurrent_disk_ops = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.987215 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute.max_disk_devices_to_attach = -1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.987743 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.988469 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute.resource_provider_association_refresh = 300 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.989337 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] compute.shutdown_retry_interval = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.990107 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] conductor.workers = 2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.990840 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] console.allowed_origins = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.992009 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] console.ssl_ciphers = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.992655 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] console.ssl_minimum_version = default {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.994349 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] consoleauth.token_ttl = 600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.994999 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.995527 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.996171 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.996917 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.connect_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.997566 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.connect_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.998092 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.endpoint_override = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.998635 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:46.999420 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.000097 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.max_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.001028 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.min_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.001656 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.region_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.002307 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.service_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.002866 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.service_type = accelerator {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.003400 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.004067 n-d-819181-1 nova-conductor[89841]: DEBUG nova.service [None req-0e16df90-c01e-4f60-9a29-c12d15040fcd None None] Join ServiceGroup membership for this service conductor {{(pid=89841) start /opt/stack/nova/nova/service.py:199}} Nov 25 14:38:47.004329 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.status_code_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.004860 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.status_code_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.005419 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.005528 n-d-819181-1 nova-conductor[89841]: DEBUG nova.servicegroup.drivers.db [None req-0e16df90-c01e-4f60-9a29-c12d15040fcd None None] DB_Driver: join new ServiceGroup member n-d-819181-1 to the conductor group, service = {{(pid=89841) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Nov 25 14:38:47.006091 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.006736 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] cyborg.version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.007992 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.backend = sqlalchemy {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.008617 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.connection = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.009299 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.connection_debug = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.009843 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.connection_parameters = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.010518 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.connection_recycle_time = 3600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.011059 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.connection_trace = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.011600 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.db_inc_retry_interval = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.012231 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.db_max_retries = 20 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.012769 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.db_max_retry_interval = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.013315 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.db_retry_interval = 1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.013976 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.max_overflow = 50 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.014599 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.max_pool_size = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.015161 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.max_retries = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.015685 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.mysql_enable_ndb = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.016237 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.016875 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.pool_timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.017440 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.retry_interval = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.019572 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.slave_connection = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.019989 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.sqlite_synchronous = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.020521 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.use_db_reconnect = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.020935 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] database.use_tpool = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.021377 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.connection = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.021790 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.connection_debug = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.022188 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.connection_parameters = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.023236 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.connection_recycle_time = 3600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.023623 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.connection_trace = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.024030 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.max_overflow = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.024433 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.max_pool_size = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.024822 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.max_retries = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.025520 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.026087 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.pool_timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.026475 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.retry_interval = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.027104 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.slave_connection = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.027498 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] api_database.sqlite_synchronous = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.027925 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] devices.enabled_vgpu_types = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.028340 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.028758 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ephemeral_storage_encryption.enabled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.029147 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.029627 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.allowed_direct_url_schemes = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.030010 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.api_servers = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.030424 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.030799 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.031201 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.031667 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.connect_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.032074 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.connect_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.032500 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.debug = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.032902 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.default_trusted_certificate_ids = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.034197 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.enable_certificate_validation = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.034197 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.enable_rbd_download = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.036150 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.endpoint_override = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.036621 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.038095 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.039087 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.max_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.039484 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.min_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.039878 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.num_retries = 3 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.040351 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.rbd_ceph_conf = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.040790 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.rbd_connect_timeout = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.041842 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.rbd_pool = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.042279 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.rbd_user = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.043429 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.region_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.044008 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.service_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.045368 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.service_type = image {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.045771 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.046159 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.status_code_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.050414 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.status_code_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.050414 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.050899 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.051790 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.verify_glance_signatures = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.051790 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] glance.version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.052076 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] guestfs.debug = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.052508 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.config_drive_cdrom = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.052918 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.config_drive_inject_password = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.053365 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.053756 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.enable_instance_metrics_collection = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.054180 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.enable_remotefx = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.054618 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.instances_path_share = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.055019 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.iscsi_initiator_list = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.055400 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.limit_cpu_features = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.055785 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.056194 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.056579 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.power_state_check_timeframe = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.056964 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.057379 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.057763 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.use_multipath_io = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.058149 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.volume_attach_retry_count = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.058532 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.058933 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.vswitch_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.059321 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.059818 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] mks.enabled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.060879 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.061352 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] image_cache.manager_interval = 2400 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.061813 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] image_cache.precache_concurrency = 1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.062210 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] image_cache.remove_unused_base_images = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.062602 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.062992 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.063405 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] image_cache.subdirectory_name = _base {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.063840 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.api_max_retries = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.064282 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.api_retry_interval = 2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.064665 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.auth_section = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.065047 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.auth_type = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.065463 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.065843 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.066223 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.066623 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.connect_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.067001 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.connect_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.067381 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.endpoint_override = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.067766 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.068129 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.068504 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.max_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.068875 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.min_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.069306 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.partition_key = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.069724 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.peer_list = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.070212 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.region_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.070601 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.serial_console_state_timeout = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.070978 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.service_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.071392 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.service_type = baremetal {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.071776 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.072852 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.status_code_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.073799 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.status_code_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.074237 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.074658 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.075049 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ironic.version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.075467 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.075898 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] key_manager.fixed_key = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.076354 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.076605 n-d-819181-1 nova-conductor[89840]: DEBUG nova.service [None req-fdd754c3-6184-4c03-8d64-b960fa8270cb None None] Join ServiceGroup membership for this service conductor {{(pid=89840) start /opt/stack/nova/nova/service.py:199}} Nov 25 14:38:47.076776 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.barbican_api_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.077129 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.barbican_endpoint = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.077547 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.barbican_endpoint_type = public {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.077944 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.078327 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.078703 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.079082 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.079392 n-d-819181-1 nova-conductor[89840]: DEBUG nova.servicegroup.drivers.db [None req-fdd754c3-6184-4c03-8d64-b960fa8270cb None None] DB_Driver: join new ServiceGroup member n-d-819181-1 to the conductor group, service = {{(pid=89840) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Nov 25 14:38:47.079494 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.079844 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.number_of_retries = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.080337 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.retry_delay = 1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.080719 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.081121 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.081512 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.verify_ssl = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.082420 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] barbican.verify_ssl_path = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.082838 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.approle_role_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.083218 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.approle_secret_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.083595 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.083970 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.084355 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.084733 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.085659 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.086109 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.kv_mountpoint = secret {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.086491 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.kv_version = 2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.086869 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.root_token_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.087249 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.087624 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.ssl_ca_crt_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.088000 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.088385 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.use_ssl = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.088804 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.089265 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.089644 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.090045 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.090539 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.connect_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.090927 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.connect_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.091304 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.endpoint_override = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.091691 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.092069 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.092454 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.max_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.092828 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.min_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.093231 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.region_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.093614 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.service_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.094034 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.service_type = identity {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.094416 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.094796 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.status_code_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.095175 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.status_code_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.095559 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.095982 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.096354 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] keystone.version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.096822 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.connection_uri = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.097268 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.cpu_mode = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.097655 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.cpu_model_extra_flags = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.098102 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.cpu_models = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.098485 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.disk_cachemodes = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.098864 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.disk_prefix = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.099279 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.enabled_perf_events = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.099659 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.file_backed_memory = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.100048 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.gid_maps = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.100538 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.hw_disk_discard = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.101534 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.hw_machine_type = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.101934 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.images_rbd_ceph_conf = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.102321 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.102738 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.103131 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.images_rbd_glance_store_name = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.103522 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.images_rbd_pool = rbd {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.103930 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.images_type = default {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.104313 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.images_volume_group = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.104688 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.inject_key = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.105150 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.inject_partition = -2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.105542 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.inject_password = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.106198 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.iscsi_iface = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.106579 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.iser_use_multipath = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.106958 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_bandwidth = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.107338 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.107721 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_downtime = 500 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.108102 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.108477 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.108887 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_inbound_addr = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.109301 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.109677 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_permit_post_copy = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.110056 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_scheme = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.110554 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_timeout_action = abort {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.110961 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_tunnelled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.111334 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_uri = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.111712 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.live_migration_with_native_tls = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.112106 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.max_queues = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.112493 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.112864 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.nfs_mount_options = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.113422 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.113803 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.114179 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.num_iser_scan_tries = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.114558 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.num_memory_encrypted_guests = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.114935 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.115320 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.num_pcie_ports = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.115706 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.num_volume_scan_tries = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.116099 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.pmem_namespaces = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.116496 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.quobyte_client_cfg = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.116989 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.117394 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rbd_connect_timeout = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.117771 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.118148 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.118525 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rbd_secret_uuid = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.118900 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rbd_user = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.119275 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.119665 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.remote_filesystem_transport = ssh {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.120042 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rescue_image_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.120506 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rescue_kernel_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.120889 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rescue_ramdisk_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.121310 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.121682 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.rx_queue_size = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.122070 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.smbfs_mount_options = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.122557 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.122948 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.snapshot_compression = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.123328 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.snapshot_image_format = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.123804 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.124184 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.sparse_logical_volumes = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.124561 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.swtpm_enabled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.124984 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.swtpm_group = tss {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.125482 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.swtpm_user = tss {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.126014 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.sysinfo_serial = unique {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.126787 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.tx_queue_size = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.127300 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.uid_maps = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.127687 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.use_usb_tablet = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.128070 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.use_virtio_for_bridges = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.128469 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.virt_type = kvm {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.128868 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.volume_clear = zero {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.129273 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.volume_clear_size = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.129658 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.volume_use_multipath = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.130043 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.vzstorage_cache_path = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.130434 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.130941 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.vzstorage_mount_group = qemu {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.131326 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.vzstorage_mount_opts = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.131718 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.132237 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.132634 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.vzstorage_mount_user = stack {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.133211 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.133741 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.134160 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.auth_section = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.134563 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.auth_type = password {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.134942 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.135343 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.135724 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.136119 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.connect_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.136558 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.connect_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.136953 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.default_floating_pool = public {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.137351 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.endpoint_override = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.137752 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.extension_sync_interval = 600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.138168 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.http_retries = 3 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.138546 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.138930 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.139301 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.max_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.139693 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.140071 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.min_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.140466 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.ovs_bridge = br-int {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.140952 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.physnets = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.141383 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.region_name = RegionOne {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.141783 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.service_metadata_proxy = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.142333 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.service_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.142879 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.service_type = network {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.143418 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.143949 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.status_code_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.144476 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.status_code_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.144996 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.145571 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.146116 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] neutron.version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.146652 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] notifications.bdms_in_notifications = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.147204 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] notifications.default_level = INFO {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.148483 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] notifications.notification_format = unversioned {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.149058 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] notifications.notify_on_state_change = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.149655 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.150248 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] pci.alias = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.150901 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] pci.passthrough_whitelist = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.151483 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.auth_section = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.152045 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.auth_type = password {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.152597 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.auth_url = http://10.222.0.65/identity {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.153157 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.153676 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.154198 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.154715 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.connect_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.155237 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.connect_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.155799 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.default_domain_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.156328 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.default_domain_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.156851 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.domain_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.157389 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.domain_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.157907 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.endpoint_override = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.158451 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.158981 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.159497 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.max_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.160011 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.min_version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.160546 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.password = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.161177 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.project_domain_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.161728 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.project_domain_name = Default {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.162294 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.project_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.162877 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.project_name = service {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.163521 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.region_name = RegionOne {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.164245 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.service_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.164860 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.service_type = placement {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.165449 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.166016 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.status_code_retries = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.166569 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.status_code_retry_delay = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.167113 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.system_scope = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.167657 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.168219 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.trust_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.168764 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.user_domain_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.169355 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.user_domain_name = Default {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.169935 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.user_id = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.170513 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.username = placement {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.171217 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.171782 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] placement.version = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.172352 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] powervm.disk_driver = localdisk {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.172889 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] powervm.proc_units_factor = 0.1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.173465 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] powervm.volume_group_name = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.174026 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.cores = 20 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.174609 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.count_usage_from_placement = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.175224 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.175816 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.injected_file_content_bytes = 10240 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.176347 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.injected_file_path_length = 255 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.176874 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.injected_files = 5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.177439 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.instances = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.177969 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.key_pairs = 100 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.178497 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.metadata_items = 128 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.179688 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.ram = 51200 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.180377 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.recheck_quota = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.180935 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.server_group_members = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.181609 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] quota.server_groups = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.182146 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] rdp.enabled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.182964 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.183564 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.184113 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.driver = filter_scheduler {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.184658 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.185220 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.image_metadata_prefilter = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.185759 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.186290 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.max_attempts = 3 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.186815 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.max_placement_results = 1000 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.187361 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.periodic_task_interval = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.188426 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.188822 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.query_placement_for_availability_zone = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.189236 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.query_placement_for_image_type_support = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.189638 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] scheduler.workers = 2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.190073 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.190481 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.190998 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.191341 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.191730 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.192116 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.192513 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.193082 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.193485 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.host_subset_size = 1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.193864 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.194254 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.194747 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.isolated_hosts = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.195139 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.isolated_images = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.195627 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.196018 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.196406 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.197339 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.197339 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.197571 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.198165 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.198698 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.199589 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.track_instance_changes = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.200150 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.200706 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] metrics.required = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.201388 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] metrics.weight_multiplier = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.201923 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.202781 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] metrics.weight_setting = [] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.203395 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.203782 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] serial_console.enabled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.204207 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] serial_console.port_range = 10000:20000 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.204611 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.205034 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.205463 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] serial_console.serialproxy_port = 6083 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.205855 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.auth_section = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.206399 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.auth_type = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.206618 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.206993 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.207376 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.207764 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.208128 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.208523 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.send_service_user_token = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.208896 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.209302 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] service_user.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.209693 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] spice.agent_enabled = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.210611 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] spice.enabled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.211330 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.211789 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.212201 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] spice.html5proxy_port = 6082 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.212599 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] spice.server_listen = 127.0.0.1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.212997 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.213425 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] upgrade_levels.baseapi = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.213804 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] upgrade_levels.cert = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.214198 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] upgrade_levels.compute = auto {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.214579 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] upgrade_levels.conductor = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.214956 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] upgrade_levels.scheduler = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.215342 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vendordata_dynamic_auth.auth_section = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.215769 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vendordata_dynamic_auth.auth_type = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.216162 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vendordata_dynamic_auth.cafile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.216531 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vendordata_dynamic_auth.certfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.216908 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.217305 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vendordata_dynamic_auth.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.217680 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vendordata_dynamic_auth.keyfile = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.218063 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.218443 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vendordata_dynamic_auth.timeout = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.218888 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.api_retry_count = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.219265 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.ca_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.219638 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.cache_prefix = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.220009 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.cluster_name = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.220390 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.connection_pool_size = 10 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.220769 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.console_delay_seconds = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.221162 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.datastore_regex = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.221586 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.host_ip = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.221952 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.host_password = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.222328 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.host_port = 443 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.222700 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.host_username = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.223083 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.insecure = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.223477 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.integration_bridge = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.223839 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.maximum_objects = 100 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.224212 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.pbm_default_policy = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.224590 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.pbm_enabled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.224968 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.pbm_wsdl_location = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.225377 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.225848 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.serial_port_proxy_uri = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.226228 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.serial_port_service_uri = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.226686 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.task_poll_interval = 0.5 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.227078 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.use_linked_clone = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.227469 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.vnc_keymap = en-us {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.227853 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.vnc_port = 5900 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.228279 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vmware.vnc_port_total = 10000 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.228760 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.auth_schemes = ['none'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.229187 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.enabled = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.229803 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.230207 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.230603 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.novncproxy_port = 6080 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.231291 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.server_listen = 127.0.0.1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.231708 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.232089 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.vencrypt_ca_certs = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.232472 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.vencrypt_client_cert = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.232847 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] vnc.vencrypt_client_key = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.233260 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.233672 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.234052 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.234431 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.disable_native_luksv1 = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.234809 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.disable_rootwrap = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.235197 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.enable_numa_live_migration = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.235575 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.235954 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.236360 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.236758 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.rbd_volume_local_attach = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.237155 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.237587 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.237985 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.client_socket_timeout = 900 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.238370 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.default_pool_size = 1000 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.238753 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.keep_alive = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.239141 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.max_header_line = 16384 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.239532 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.secure_proxy_ssl_header = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.239901 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.ssl_ca_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.240295 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.ssl_cert_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.240664 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.ssl_key_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.241125 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.tcp_keepidle = 600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.242237 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.242626 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] zvm.ca_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.243005 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] zvm.cloud_connector_url = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.243497 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.243876 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] zvm.reachable_timeout = 300 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.244321 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.enforce_new_defaults = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.244708 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.enforce_scope = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.245162 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.policy_default_rule = default {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.245573 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.245976 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.policy_file = policy.yaml {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.246419 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.246839 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.247169 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.247545 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.247926 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.248337 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.248788 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.connection_string = messaging:// {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.249235 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.enabled = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.249610 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.es_doc_type = notification {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.250085 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.es_scroll_size = 10000 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.250485 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.es_scroll_time = 2m {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.250867 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.filter_error_trace = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.251279 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.hmac_keys = SECRET_KEY {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.251667 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.sentinel_service_name = mymaster {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.252129 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.socket_timeout = 0.1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.252444 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] profiler.trace_sqlalchemy = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.252860 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] remote_debug.host = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.253262 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] remote_debug.port = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.253680 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.254060 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.254443 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.254821 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.255247 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.255590 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.255970 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.256380 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.256856 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.257867 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.258560 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.259213 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.259895 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.260566 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.261281 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.261997 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.262583 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.262985 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.263375 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.263770 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.264165 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.264563 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.ssl = False {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.264971 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.265398 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.265820 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.266224 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.266684 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.267075 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_notifications.retry = -1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.267492 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.267895 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.268323 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_reports.file_event_handler = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.268727 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.269151 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] oslo_reports.log_dir = None {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 14:38:47.269519 n-d-819181-1 nova-conductor[88954]: DEBUG oslo_service.service [None req-17089a5a-ef59-4e65-9b19-249624e49e45 None None] ******************************************************************************** {{(pid=88954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 25 14:41:46.975242 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 14:41:47.041117 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 14:41:47.999512 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46770. Nov 25 14:41:48.064921 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46772. Nov 25 14:44:47.993896 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 14:44:48.058878 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 14:44:49.015526 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46832. Nov 25 14:44:49.081732 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46834. Nov 25 14:47:49.010898 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 14:47:49.077803 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 14:47:50.037477 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46954. Nov 25 14:47:50.108436 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46956. Nov 25 14:48:23.927097 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_db.sqlalchemy.engines [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Parent process 88954 forked (89841) with an open database connection, which is being discarded and recreated. {{(pid=89841) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Nov 25 14:48:25.632788 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Took 1.69 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:48:25.721516 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:25.725756 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:25.757894 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_db.sqlalchemy.engines [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 25 14:48:25.960235 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:25.965189 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:25.981222 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:25.982429 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:26.045306 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_db.sqlalchemy.engines [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 25 14:48:26.091511 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Getting quotas for project 2fdd25cac04b46499bb818b3d219ebd9. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:48:26.098966 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Getting quotas for user fa2ed8143b5f4155b6f0239db2548de7 and project 2fdd25cac04b46499bb818b3d219ebd9. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:48:26.120545 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] [instance: 2b396163-02c2-4aa7-b852-1caab0fb48b8] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:48:26.121660 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:26.122064 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:26.143118 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] [instance: 2b396163-02c2-4aa7-b852-1caab0fb48b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:48:26.146269 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:26.146673 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:26.225389 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:26.226689 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:26.227317 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8d4aaa68-7809-41ea-a011-614aa13f0f56 tempest-AggregatesAdminTestJSON-354338835 tempest-AggregatesAdminTestJSON-354338835-project] Acquired lock "compute-rpcapi-router" {{(pid=89841) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 25 14:48:26.230236 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-89c8b303-0042-4a45-bfd0-0215d9ce4c62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:26.231249 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-89c8b303-0042-4a45-bfd0-0215d9ce4c62 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:26.232550 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-89c8b303-0042-4a45-bfd0-0215d9ce4c62 None None] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:26.233653 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-89c8b303-0042-4a45-bfd0-0215d9ce4c62 None None] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:26.246481 n-d-819181-1 nova-conductor[89841]: INFO nova.compute.rpcapi [None req-89c8b303-0042-4a45-bfd0-0215d9ce4c62 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Nov 25 14:48:26.248055 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-89c8b303-0042-4a45-bfd0-0215d9ce4c62 None None] Releasing lock "compute-rpcapi-router" {{(pid=89841) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 25 14:48:36.828191 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_db.sqlalchemy.engines [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Parent process 88954 forked (89840) with an open database connection, which is being discarded and recreated. {{(pid=89840) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Nov 25 14:48:37.611574 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:48:37.697599 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:37.706050 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:37.744488 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_db.sqlalchemy.engines [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 25 14:48:38.003149 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:38.005623 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:38.014016 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:38.015343 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:38.066838 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_db.sqlalchemy.engines [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 25 14:48:38.117499 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Getting quotas for project 3270bc371c3f4caf9093b5da2996b5be. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:48:38.123529 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Getting quotas for user 419f542f80b84416a7adb800bf24a7f0 and project 3270bc371c3f4caf9093b5da2996b5be. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:48:38.151837 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] [instance: b520b81d-d855-46bb-ae57-6abe0a15f4c4] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:48:38.153410 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:38.157235 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:38.183981 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] [instance: b520b81d-d855-46bb-ae57-6abe0a15f4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:48:38.195685 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:38.197434 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:38.323416 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:38.324340 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:38.325544 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ead2e5dd-76ee-498d-ab0e-0d6cf9447406 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Acquired lock "compute-rpcapi-router" {{(pid=89840) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 25 14:48:38.327301 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ec20be0e-788c-4089-b634-0283e98fd82c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:38.327935 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ec20be0e-788c-4089-b634-0283e98fd82c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:38.329213 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ec20be0e-788c-4089-b634-0283e98fd82c None None] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:38.329949 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ec20be0e-788c-4089-b634-0283e98fd82c None None] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:38.348456 n-d-819181-1 nova-conductor[89840]: INFO nova.compute.rpcapi [None req-ec20be0e-788c-4089-b634-0283e98fd82c None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Nov 25 14:48:38.350008 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ec20be0e-788c-4089-b634-0283e98fd82c None None] Releasing lock "compute-rpcapi-router" {{(pid=89840) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 25 14:48:41.683032 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:48:41.752668 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:41.753549 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:41.921216 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:41.923613 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:41.924988 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:41.926306 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:42.033906 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Getting quotas for project 2140cc2a5eb64bd5859b2563baeab03d. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:48:42.068075 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Getting quotas for user c9e61281c8844e78bda0f71e9237bac6 and project 2140cc2a5eb64bd5859b2563baeab03d. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:48:42.103902 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] [instance: cd70303e-48e0-4004-b4e3-a70a59012aef] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:48:42.104831 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:42.114830 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:42.135816 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] [instance: cd70303e-48e0-4004-b4e3-a70a59012aef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:48:42.139152 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:42.139763 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:48:42.277475 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:48:42.277695 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3c6ef0cc-5931-461a-92d5-2a7a143c1b98 tempest-ServerDiagnosticsNegativeTest-1000643308 tempest-ServerDiagnosticsNegativeTest-1000643308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:02.469116 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:02.504434 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:02.505476 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:02.602721 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:02.603575 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:02.604576 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:02.604981 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:02.636021 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Getting quotas for project a0a111fea487453f88d108ab6f1340d5. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:02.658204 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Getting quotas for user 2fe7c9e0d79b4aae9eef04f3461892b6 and project a0a111fea487453f88d108ab6f1340d5. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:02.683349 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] [instance: 00bca903-69b7-4ec5-bf0d-51c0ef777947] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:02.685271 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:02.685960 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:02.697704 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] [instance: 00bca903-69b7-4ec5-bf0d-51c0ef777947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:02.700251 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:02.702284 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:02.758918 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:02.759409 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-325fb2c9-7840-4b5b-a6ef-48459c524391 tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:09.912291 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:09.978834 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:09.979242 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:10.077826 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:10.079719 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:10.080996 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:10.081942 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:10.113168 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Getting quotas for project 3270bc371c3f4caf9093b5da2996b5be. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:10.119636 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Getting quotas for user 419f542f80b84416a7adb800bf24a7f0 and project 3270bc371c3f4caf9093b5da2996b5be. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:10.156058 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] [instance: 2ead67ac-155d-4345-ac14-a84b4478b7fe] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:10.158977 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:10.166478 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:10.179727 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] [instance: 2ead67ac-155d-4345-ac14-a84b4478b7fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:10.181668 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:10.182254 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:10.239887 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:10.241009 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-af0547d3-078c-4ca8-8803-9b0ae2314e60 tempest-LiveMigrationNegativeTest-452466485 tempest-LiveMigrationNegativeTest-452466485-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:28.896708 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:28.940748 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:28.941441 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.050210 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.051006 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.051978 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.052588 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.083026 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Getting quotas for project f28b6a4ed016434b8f0fdb465ad48931. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:29.089926 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Getting quotas for user 17f6e6d0687e40b48397eefb5db70d63 and project f28b6a4ed016434b8f0fdb465ad48931. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:29.105320 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] [instance: e591a23d-0388-443c-a7d9-a5d59457f04b] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:29.109928 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.111051 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.135724 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] [instance: e591a23d-0388-443c-a7d9-a5d59457f04b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:29.137520 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.139308 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.183403 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:29.196851 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.198023 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a9e94dcb-c458-450b-970c-62f07b9688b3 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.212186 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.212683 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.322015 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.322568 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.323302 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.323697 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.365142 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Getting quotas for project 7f3fb674b34746e1bbd9b3bca442c449. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:29.377674 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Getting quotas for user 1f650f0218084294af8400a40930b95d and project 7f3fb674b34746e1bbd9b3bca442c449. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:29.391507 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] [instance: c93dc489-7b2c-4558-bdd9-8bf6db36b280] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:29.392732 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.393258 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.406188 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] [instance: c93dc489-7b2c-4558-bdd9-8bf6db36b280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:29.409476 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.410902 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:29.468760 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:29.469206 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0ed84dd3-43aa-4681-94f8-49724800fe10 tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:31.572977 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:31.666019 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:31.666514 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:31.839171 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:31.839583 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:31.845500 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:31.847819 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:31.876961 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Getting quotas for project ec5f7b1999e14e269c73708174e40a14. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:31.882138 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Getting quotas for user 0ad48078fa6f44c39e8e0ef8ab0ff63e and project ec5f7b1999e14e269c73708174e40a14. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:31.894880 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] [instance: 88e55d79-887d-4503-97d0-b6873171eddb] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:31.896356 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:31.897767 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:31.910483 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] [instance: 88e55d79-887d-4503-97d0-b6873171eddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:31.911781 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:31.913632 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:32.024928 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:32.027200 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6cbbae1d-dfff-4d8c-96bd-af3fe6234233 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:43.307120 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:43.351018 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:43.355258 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:43.466965 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:43.467446 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:43.468244 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:43.468705 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:43.495566 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Getting quotas for project db1e5279c6f848239dacbc1c1bb57bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:43.508748 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Getting quotas for user b6c22640f94d4ae4ad255f45ccec3d98 and project db1e5279c6f848239dacbc1c1bb57bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:43.518954 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] [instance: 72a68d46-e2d9-462b-829a-a2dfdbe79f86] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:43.519987 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:43.520463 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:43.534937 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] [instance: 72a68d46-e2d9-462b-829a-a2dfdbe79f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:43.536520 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:43.537736 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:43.596865 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:43.597406 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a0ab6913-862a-48d2-82fa-7f1e50fc6cfd tempest-TenantUsagesTestJSON-1417363308 tempest-TenantUsagesTestJSON-1417363308-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:45.128957 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:45.180085 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:45.185683 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:45.260878 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:45.262210 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:45.263567 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:45.266773 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:45.307026 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Getting quotas for project d660c3e09a324eaea5fb1b1f64d309a1. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:45.311605 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Getting quotas for user 4e8b8ae1deee42949ee09bceffbc1d29 and project d660c3e09a324eaea5fb1b1f64d309a1. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:45.332642 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] [instance: 99e712d4-d2dc-42f3-b61c-4797394e82ad] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:45.335611 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:45.337550 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:45.356230 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] [instance: 99e712d4-d2dc-42f3-b61c-4797394e82ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:45.359735 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:45.360281 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:45.431184 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:45.431851 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0eaadafb-1336-49d5-a41a-3f1fee5bff16 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:46.671730 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:46.742369 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:46.743499 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:46.803092 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:46.804292 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:46.805911 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:46.806464 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:46.837143 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Getting quotas for project d660c3e09a324eaea5fb1b1f64d309a1. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:46.842672 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Getting quotas for user 4e8b8ae1deee42949ee09bceffbc1d29 and project d660c3e09a324eaea5fb1b1f64d309a1. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:46.863743 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] [instance: ece7bec2-a464-4640-bdb0-2bbbd7d8b2a8] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:46.864977 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:46.866283 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:46.878936 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] [instance: ece7bec2-a464-4640-bdb0-2bbbd7d8b2a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:46.891777 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:46.898042 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:46.973425 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:46.974716 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3b9c347-0393-4dd7-aa62-28039e8b7b3c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:50.126552 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:50.202200 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:50.202620 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:50.349934 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:50.351011 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:50.351964 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:50.352519 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:50.407503 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Getting quotas for project 075746a3ea344885bf5424df569c7a35. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:50.412935 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Getting quotas for user 0eba5a0e4895497daf850df5d61d7951 and project 075746a3ea344885bf5424df569c7a35. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:50.439082 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 926c6296-30d6-4103-9fee-77ee922598a1] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:50.440036 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:50.444651 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:50.461534 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 926c6296-30d6-4103-9fee-77ee922598a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:50.465717 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:50.467990 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:50.525392 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:50.527408 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c3d93aa4-d90e-4bd4-bb2a-4c280a48b044 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:55.883916 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:49:55.941919 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:55.942392 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:56.025474 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:56.026167 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:56.027166 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:56.034242 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:56.090125 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Getting quotas for project f28b6a4ed016434b8f0fdb465ad48931. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:49:56.096782 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Getting quotas for user 17f6e6d0687e40b48397eefb5db70d63 and project f28b6a4ed016434b8f0fdb465ad48931. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:49:56.122738 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] [instance: 47d4b076-9174-4501-9225-333d2f815a2e] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:49:56.129522 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:56.130437 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:56.146795 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] [instance: 47d4b076-9174-4501-9225-333d2f815a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:49:56.148495 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:56.149317 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:49:56.206392 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:49:56.207035 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9001145-267e-44ac-b06a-5bd6b9e42a09 tempest-ServersAdminNegativeTestJSON-1796856877 tempest-ServersAdminNegativeTestJSON-1796856877-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:00.676769 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-073f8122-dc29-4964-a64a-0cc753e27ef2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:50:00.678054 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-073f8122-dc29-4964-a64a-0cc753e27ef2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:00.678654 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-073f8122-dc29-4964-a64a-0cc753e27ef2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:01.403173 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-073f8122-dc29-4964-a64a-0cc753e27ef2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Created allocations for migration c4fa3906-8d0f-413a-a93b-004c8d56ff01 on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:50:01.703243 n-d-819181-1 nova-conductor[89840]: DEBUG nova.scheduler.utils [None req-073f8122-dc29-4964-a64a-0cc753e27ef2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] [instance: 88e55d79-887d-4503-97d0-b6873171eddb] Instance allocations successfully created on destination node c70a3c4d-08ee-470c-b8da-baacf1e5a82b: {'allocations': {'c70a3c4d-08ee-470c-b8da-baacf1e5a82b': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89840) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Nov 25 14:50:01.703821 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-073f8122-dc29-4964-a64a-0cc753e27ef2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lazy-loading 'resources' on Instance uuid 88e55d79-887d-4503-97d0-b6873171eddb {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:50:01.711496 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-073f8122-dc29-4964-a64a-0cc753e27ef2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lazy-loading 'pci_requests' on Instance uuid 88e55d79-887d-4503-97d0-b6873171eddb {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:50:02.185141 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.live_migrate [None req-073f8122-dc29-4964-a64a-0cc753e27ef2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] [instance: 88e55d79-887d-4503-97d0-b6873171eddb] Start binding ports on destination host: n-h2-819181-1 {{(pid=89840) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Nov 25 14:50:06.095161 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:50:06.138497 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:06.138907 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:06.204971 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:06.205474 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:06.206271 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:06.206678 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:06.226303 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Getting quotas for project 7f3fb674b34746e1bbd9b3bca442c449. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:50:06.230414 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Getting quotas for user 1f650f0218084294af8400a40930b95d and project 7f3fb674b34746e1bbd9b3bca442c449. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:50:06.242695 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] [instance: 52e00861-d28d-477b-9ae2-abbd2da0839f] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:50:06.243913 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:06.244287 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:06.251777 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] [instance: 52e00861-d28d-477b-9ae2-abbd2da0839f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:50:06.253327 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:06.253736 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:06.288707 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:06.289447 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c9d065ba-0a1b-4533-9e23-22ff65fcf78b tempest-DeleteServersAdminTestJSON-10056849 tempest-DeleteServersAdminTestJSON-10056849-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:13.212070 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:50:13.244854 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:13.245509 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:13.303082 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:13.303555 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:13.304294 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:13.304833 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:13.325007 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Getting quotas for project d660c3e09a324eaea5fb1b1f64d309a1. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:50:13.329281 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Getting quotas for user 4e8b8ae1deee42949ee09bceffbc1d29 and project d660c3e09a324eaea5fb1b1f64d309a1. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:50:13.340042 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] [instance: 055cd141-ff51-4a3d-b584-5c052a6b7ad7] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:50:13.341044 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:13.341483 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:13.349311 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] [instance: 055cd141-ff51-4a3d-b584-5c052a6b7ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:50:13.350409 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:13.350814 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:13.391641 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:13.392141 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9a315881-e169-4dab-84a2-22cbee9b3e1c tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:14.704589 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-acf3ae8e-619c-4576-9518-a9f9edf69f42 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:50:14.706094 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-acf3ae8e-619c-4576-9518-a9f9edf69f42 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:14.706614 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-acf3ae8e-619c-4576-9518-a9f9edf69f42 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:15.496215 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-acf3ae8e-619c-4576-9518-a9f9edf69f42 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] [instance: 926c6296-30d6-4103-9fee-77ee922598a1] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89841) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 14:50:16.146792 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-acf3ae8e-619c-4576-9518-a9f9edf69f42 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] Created allocations for migration 56fb7a3d-2402-451e-955a-5278b08cccb7 on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:50:16.438218 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-acf3ae8e-619c-4576-9518-a9f9edf69f42 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] [instance: 926c6296-30d6-4103-9fee-77ee922598a1] Calling prep_resize with selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89841) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 14:50:31.060702 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:50:31.106713 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:31.107542 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:31.201512 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:31.202200 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:31.205795 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:31.207025 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:31.234444 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Getting quotas for project 4b8bf59f6093499bafceae0c11839f86. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:50:31.238468 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Getting quotas for user a276db30666240639c0518b74fe18907 and project 4b8bf59f6093499bafceae0c11839f86. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:50:31.250442 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] [instance: 03ccdb67-7077-4e68-8b52-b8e2b51f3ea1] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:50:31.251319 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:31.253558 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:31.269181 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] [instance: 03ccdb67-7077-4e68-8b52-b8e2b51f3ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:50:31.270903 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:31.271332 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:31.312856 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:31.313676 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c90df55d-97ee-4747-a72f-3253fe9fb0d7 tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:44.813419 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:50:44.849105 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:44.850026 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:44.920129 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:44.920882 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:44.922073 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:44.922665 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:44.956659 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Getting quotas for project ec5f7b1999e14e269c73708174e40a14. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:50:44.961988 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Getting quotas for user 0ad48078fa6f44c39e8e0ef8ab0ff63e and project ec5f7b1999e14e269c73708174e40a14. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:50:44.975686 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] [instance: 51b8d4e3-2bb8-4f7d-8bfa-5ba7af28679f] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:50:44.976931 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:44.977522 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:44.991278 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] [instance: 51b8d4e3-2bb8-4f7d-8bfa-5ba7af28679f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:50:44.993119 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:44.993614 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:45.052580 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:45.053026 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-545a0da5-8485-451e-8dda-d868844110d7 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:55.446586 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-0788420c-236e-4f56-b92b-6f5d03bf9469 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method rebuild_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:50:55.449392 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0788420c-236e-4f56-b92b-6f5d03bf9469 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:50:55.450019 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0788420c-236e-4f56-b92b-6f5d03bf9469 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:50:55.490563 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-0788420c-236e-4f56-b92b-6f5d03bf9469 tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] [instance: 99e712d4-d2dc-42f3-b61c-4797394e82ad] No migration record for the rebuild/evacuate request. {{(pid=89840) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Nov 25 14:51:03.160341 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:51:03.251746 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:03.252166 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:03.365717 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:03.366596 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:03.367544 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:03.368449 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:03.394478 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Getting quotas for project 4b8bf59f6093499bafceae0c11839f86. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:51:03.400516 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Getting quotas for user a276db30666240639c0518b74fe18907 and project 4b8bf59f6093499bafceae0c11839f86. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:51:03.419352 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] [instance: 45f0eddf-82fd-4808-8c3a-2c1bbd1f0997] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:51:03.421232 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:03.422023 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:03.438063 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] [instance: 45f0eddf-82fd-4808-8c3a-2c1bbd1f0997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:51:03.443832 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:03.445456 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:03.540574 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:03.540900 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-647e49a1-687b-4c10-a30d-206d64c842df tempest-FloatingIPsAssociationTestJSON-711629376 tempest-FloatingIPsAssociationTestJSON-711629376-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:04.643871 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:51:04.690818 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:04.693408 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:04.757421 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:04.758123 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:04.759178 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:04.759809 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:04.783218 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Getting quotas for project 075746a3ea344885bf5424df569c7a35. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:51:04.788169 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Getting quotas for user 0eba5a0e4895497daf850df5d61d7951 and project 075746a3ea344885bf5424df569c7a35. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:51:04.801645 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 902bc9d4-eae7-47c1-aafe-62366031fe28] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:51:04.802954 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:04.803542 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:04.817877 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 902bc9d4-eae7-47c1-aafe-62366031fe28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:51:04.820569 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:04.821767 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:04.872666 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:04.874246 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f49556e8-d914-401b-9e79-8989a7574de3 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:18.146209 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-92e02fea-5512-46bd-b26a-80965780248a tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:51:18.146973 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-92e02fea-5512-46bd-b26a-80965780248a tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:18.147829 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-92e02fea-5512-46bd-b26a-80965780248a tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:18.878377 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-92e02fea-5512-46bd-b26a-80965780248a tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Created allocations for migration bc939aee-6e34-4cb2-af76-542a4aff090e on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:51:19.064902 n-d-819181-1 nova-conductor[89841]: DEBUG nova.scheduler.utils [None req-92e02fea-5512-46bd-b26a-80965780248a tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] [instance: 51b8d4e3-2bb8-4f7d-8bfa-5ba7af28679f] Instance allocations successfully created on destination node c70a3c4d-08ee-470c-b8da-baacf1e5a82b: {'allocations': {'c70a3c4d-08ee-470c-b8da-baacf1e5a82b': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89841) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Nov 25 14:51:19.065404 n-d-819181-1 nova-conductor[89841]: DEBUG nova.objects.instance [None req-92e02fea-5512-46bd-b26a-80965780248a tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lazy-loading 'resources' on Instance uuid 51b8d4e3-2bb8-4f7d-8bfa-5ba7af28679f {{(pid=89841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:51:19.071750 n-d-819181-1 nova-conductor[89841]: DEBUG nova.objects.instance [None req-92e02fea-5512-46bd-b26a-80965780248a tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lazy-loading 'pci_requests' on Instance uuid 51b8d4e3-2bb8-4f7d-8bfa-5ba7af28679f {{(pid=89841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:51:19.509602 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.live_migrate [None req-92e02fea-5512-46bd-b26a-80965780248a tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] [instance: 51b8d4e3-2bb8-4f7d-8bfa-5ba7af28679f] Start binding ports on destination host: n-h2-819181-1 {{(pid=89841) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Nov 25 14:51:20.207161 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-2ecebd15-f749-454c-9ae1-1f6303cb4a3e tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method rebuild_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:51:20.210812 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2ecebd15-f749-454c-9ae1-1f6303cb4a3e tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:20.212319 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2ecebd15-f749-454c-9ae1-1f6303cb4a3e tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:20.256164 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-2ecebd15-f749-454c-9ae1-1f6303cb4a3e tempest-ServersAdminTestJSON-2069894311 tempest-ServersAdminTestJSON-2069894311-project] [instance: 99e712d4-d2dc-42f3-b61c-4797394e82ad] No migration record for the rebuild/evacuate request. {{(pid=89840) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Nov 25 14:51:22.713583 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:51:22.747329 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:22.748030 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:22.816954 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:22.817871 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:22.818204 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:22.818609 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:22.839831 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Getting quotas for project 81a5120bbc634d2c9b4edc349f39735b. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:51:22.844427 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Getting quotas for user f4ca09eb92304c40ac54b0f36576fd9b and project 81a5120bbc634d2c9b4edc349f39735b. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:51:22.855723 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] [instance: fe0b758d-81c0-4db3-9cc0-6d617d1b66b9] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:51:22.856683 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:22.857123 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:22.864655 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] [instance: fe0b758d-81c0-4db3-9cc0-6d617d1b66b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:51:22.866037 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:22.866708 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:22.902277 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:22.902710 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a941c1f0-fcb6-4b80-923f-4990b10e2f01 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:25.745061 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:51:25.777797 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:25.778220 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:25.854577 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:25.855394 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:25.856454 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:25.857057 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:25.877236 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Getting quotas for project 5f233a2287d6487bab8be5f5962796c9. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:51:25.881723 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Getting quotas for user ff4473efc42c46b898cf7f14d9335c90 and project 5f233a2287d6487bab8be5f5962796c9. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:51:25.894715 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] [instance: 99b024ac-b38c-4a47-a304-0f16e340c01e] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:51:25.907929 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:25.909007 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:25.923627 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] [instance: 99b024ac-b38c-4a47-a304-0f16e340c01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d619d09f-6969-4b4f-b55d-8d095abff585',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:51:25.927013 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:25.927988 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:25.970701 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:25.971852 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-436f961a-7265-4fa7-ac64-1df6a00afef1 tempest-AttachSCSIVolumeTestJSON-1536400561 tempest-AttachSCSIVolumeTestJSON-1536400561-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:27.377361 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2b65618b-6047-45dd-bc1c-d1747d8a63fd tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:51:27.378523 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2b65618b-6047-45dd-bc1c-d1747d8a63fd tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:27.379328 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2b65618b-6047-45dd-bc1c-d1747d8a63fd tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:27.804651 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-2b65618b-6047-45dd-bc1c-d1747d8a63fd tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 902bc9d4-eae7-47c1-aafe-62366031fe28] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89841) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 14:51:28.395300 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-2b65618b-6047-45dd-bc1c-d1747d8a63fd tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Created allocations for migration 0f6fd58e-fa10-4a20-94b7-24a87a765f83 on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:51:28.872858 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-2b65618b-6047-45dd-bc1c-d1747d8a63fd tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 902bc9d4-eae7-47c1-aafe-62366031fe28] Calling prep_resize with selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"8cc92976-9961-443c-adea-bbeeebbf35b2": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8cc92976-9961-443c-adea-bbeeebbf35b2"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=8cc92976-9961-443c-adea-bbeeebbf35b2,limits=SchedulerLimits,nodename='n-h1-819181-1',service_host='n-h1-819181-1')] {{(pid=89841) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 14:51:49.679752 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-fdd7d7af-299f-4e8c-a81e-1538903508f2 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:51:49.680363 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fdd7d7af-299f-4e8c-a81e-1538903508f2 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:49.680646 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fdd7d7af-299f-4e8c-a81e-1538903508f2 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:50.065581 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-fdd7d7af-299f-4e8c-a81e-1538903508f2 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Created allocations for migration ae5e7e94-0e9a-4e80-8503-035ec80bf936 on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:51:50.224004 n-d-819181-1 nova-conductor[89840]: DEBUG nova.scheduler.utils [None req-fdd7d7af-299f-4e8c-a81e-1538903508f2 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] [instance: fe0b758d-81c0-4db3-9cc0-6d617d1b66b9] Instance allocations successfully created on destination node c70a3c4d-08ee-470c-b8da-baacf1e5a82b: {'allocations': {'c70a3c4d-08ee-470c-b8da-baacf1e5a82b': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89840) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Nov 25 14:51:50.224698 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-fdd7d7af-299f-4e8c-a81e-1538903508f2 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lazy-loading 'resources' on Instance uuid fe0b758d-81c0-4db3-9cc0-6d617d1b66b9 {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:51:50.229771 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-fdd7d7af-299f-4e8c-a81e-1538903508f2 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lazy-loading 'pci_requests' on Instance uuid fe0b758d-81c0-4db3-9cc0-6d617d1b66b9 {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:51:50.480126 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.live_migrate [None req-fdd7d7af-299f-4e8c-a81e-1538903508f2 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] [instance: fe0b758d-81c0-4db3-9cc0-6d617d1b66b9] Start binding ports on destination host: n-h2-819181-1 {{(pid=89840) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Nov 25 14:51:51.600166 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:51:51.623929 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:51.624623 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:51.683151 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:51.683821 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:51.685194 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:51.685755 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:51.707334 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Getting quotas for project ec5f7b1999e14e269c73708174e40a14. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:51:51.712109 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Getting quotas for user 0ad48078fa6f44c39e8e0ef8ab0ff63e and project ec5f7b1999e14e269c73708174e40a14. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:51:51.724196 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] [instance: 9a564801-5af9-467f-85d5-346c1a0cfb7c] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:51:51.725173 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:51.725580 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:51.734951 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] [instance: 9a564801-5af9-467f-85d5-346c1a0cfb7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:51:51.736332 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:51.736786 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:51:51.777265 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:51:51.777819 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4f864feb-569d-477f-b316-4563d11da3ac tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:21.077221 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:52:21.130344 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:21.135344 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:21.191448 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:21.191863 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:21.192608 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:21.193206 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:21.212107 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Getting quotas for project a0a111fea487453f88d108ab6f1340d5. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:52:21.217432 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Getting quotas for user 2fe7c9e0d79b4aae9eef04f3461892b6 and project a0a111fea487453f88d108ab6f1340d5. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:52:21.229989 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] [instance: 7b469678-4e4c-4a00-a35a-d33159d8fec8] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:52:21.231520 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:21.233357 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:21.247194 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] [instance: 7b469678-4e4c-4a00-a35a-d33159d8fec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:52:21.249982 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:21.249982 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:21.262444 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:21.262822 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:21.298735 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:21.299357 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-47767235-1987-4955-828d-1bf3027d9c3c tempest-ServersWithSpecificFlavorTestJSON-1457691232 tempest-ServersWithSpecificFlavorTestJSON-1457691232-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:24.736522 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:52:24.769309 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:24.769718 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:24.816356 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:24.816756 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:24.817594 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:24.818002 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:24.835807 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Getting quotas for project 81a5120bbc634d2c9b4edc349f39735b. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:52:24.839932 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Getting quotas for user f4ca09eb92304c40ac54b0f36576fd9b and project 81a5120bbc634d2c9b4edc349f39735b. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:52:24.850743 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] [instance: c688137d-d5f2-4022-bd2e-9447b2fd995d] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:52:24.851732 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:24.852144 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:24.860074 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] [instance: c688137d-d5f2-4022-bd2e-9447b2fd995d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:52:24.861321 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:24.861742 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:24.895095 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:24.895640 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-25dc7a44-f529-41a2-987f-2408c06b181d tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:26.588156 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:52:26.611544 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:26.611928 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:26.672238 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:26.672917 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:26.674444 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:26.675614 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:26.696709 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Getting quotas for project 075746a3ea344885bf5424df569c7a35. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:52:26.701502 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Getting quotas for user 0eba5a0e4895497daf850df5d61d7951 and project 075746a3ea344885bf5424df569c7a35. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:52:26.712703 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 2f406eeb-419d-4542-906c-6825edd0d48c] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:52:26.713700 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:26.714247 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:26.728178 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 2f406eeb-419d-4542-906c-6825edd0d48c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:52:26.734535 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:26.735409 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:26.783913 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:26.785284 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-07ecaeea-a1ee-4b4b-953a-049420ce2159 tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:36.723664 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-b5da4c92-6f8a-4be0-aeb5-ac47cb36f449 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:52:36.725060 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b5da4c92-6f8a-4be0-aeb5-ac47cb36f449 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:36.725647 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b5da4c92-6f8a-4be0-aeb5-ac47cb36f449 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:37.205511 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-b5da4c92-6f8a-4be0-aeb5-ac47cb36f449 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Created allocations for migration ad7f6fd1-95b3-40a3-ada4-ff93e09f2a38 on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:52:37.323753 n-d-819181-1 nova-conductor[89841]: DEBUG nova.scheduler.utils [None req-b5da4c92-6f8a-4be0-aeb5-ac47cb36f449 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] [instance: 9a564801-5af9-467f-85d5-346c1a0cfb7c] Instance allocations successfully created on destination node c70a3c4d-08ee-470c-b8da-baacf1e5a82b: {'allocations': {'c70a3c4d-08ee-470c-b8da-baacf1e5a82b': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89841) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Nov 25 14:52:37.324191 n-d-819181-1 nova-conductor[89841]: DEBUG nova.objects.instance [None req-b5da4c92-6f8a-4be0-aeb5-ac47cb36f449 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lazy-loading 'resources' on Instance uuid 9a564801-5af9-467f-85d5-346c1a0cfb7c {{(pid=89841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:52:37.330132 n-d-819181-1 nova-conductor[89841]: DEBUG nova.objects.instance [None req-b5da4c92-6f8a-4be0-aeb5-ac47cb36f449 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lazy-loading 'pci_requests' on Instance uuid 9a564801-5af9-467f-85d5-346c1a0cfb7c {{(pid=89841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:52:37.654466 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.live_migrate [None req-b5da4c92-6f8a-4be0-aeb5-ac47cb36f449 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] [instance: 9a564801-5af9-467f-85d5-346c1a0cfb7c] Start binding ports on destination host: n-h2-819181-1 {{(pid=89841) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Nov 25 14:52:52.105601 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-e57cb2e1-7c3e-4dc5-ac0e-6d6a347e7c89 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:52:52.107690 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-e57cb2e1-7c3e-4dc5-ac0e-6d6a347e7c89 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:52.108471 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-e57cb2e1-7c3e-4dc5-ac0e-6d6a347e7c89 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:52.752517 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-e57cb2e1-7c3e-4dc5-ac0e-6d6a347e7c89 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Created allocations for migration 7a644aed-f84b-4f6c-97c5-ac70c00ee071 on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:52:52.920523 n-d-819181-1 nova-conductor[89840]: DEBUG nova.scheduler.utils [None req-e57cb2e1-7c3e-4dc5-ac0e-6d6a347e7c89 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] [instance: c688137d-d5f2-4022-bd2e-9447b2fd995d] Instance allocations successfully created on destination node c70a3c4d-08ee-470c-b8da-baacf1e5a82b: {'allocations': {'c70a3c4d-08ee-470c-b8da-baacf1e5a82b': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89840) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Nov 25 14:52:52.921205 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-e57cb2e1-7c3e-4dc5-ac0e-6d6a347e7c89 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lazy-loading 'resources' on Instance uuid c688137d-d5f2-4022-bd2e-9447b2fd995d {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:52:52.927452 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-e57cb2e1-7c3e-4dc5-ac0e-6d6a347e7c89 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lazy-loading 'pci_requests' on Instance uuid c688137d-d5f2-4022-bd2e-9447b2fd995d {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:52:53.273737 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.live_migrate [None req-e57cb2e1-7c3e-4dc5-ac0e-6d6a347e7c89 tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] [instance: c688137d-d5f2-4022-bd2e-9447b2fd995d] Start binding ports on destination host: n-h2-819181-1 {{(pid=89840) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Nov 25 14:52:55.937976 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a4141da8-ddfb-4f83-855c-6fc7f9936f5e tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:52:55.938559 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a4141da8-ddfb-4f83-855c-6fc7f9936f5e tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:52:55.938924 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a4141da8-ddfb-4f83-855c-6fc7f9936f5e tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:52:56.230564 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-a4141da8-ddfb-4f83-855c-6fc7f9936f5e tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 2f406eeb-419d-4542-906c-6825edd0d48c] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89841) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 14:52:57.073863 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-a4141da8-ddfb-4f83-855c-6fc7f9936f5e tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Created allocations for migration e97cf36a-a442-49fd-bfbe-c22dc60fc691 on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:52:57.496137 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-a4141da8-ddfb-4f83-855c-6fc7f9936f5e tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 2f406eeb-419d-4542-906c-6825edd0d48c] Calling prep_resize with selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"8cc92976-9961-443c-adea-bbeeebbf35b2": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8cc92976-9961-443c-adea-bbeeebbf35b2"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=8cc92976-9961-443c-adea-bbeeebbf35b2,limits=SchedulerLimits,nodename='n-h1-819181-1',service_host='n-h1-819181-1')] {{(pid=89841) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 14:53:26.075718 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:53:26.123675 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:26.125186 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:26.251043 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:26.251459 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:26.252186 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:26.252586 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:26.301027 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Getting quotas for project 84bb27cdf7184fce970c7c06be1d9caa. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:53:26.314323 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Getting quotas for user cb29db749a1d4fbdb474339d2088dc28 and project 84bb27cdf7184fce970c7c06be1d9caa. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:53:26.332326 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] [instance: 0e2f6f96-67df-403a-8dd1-d9fcf7ca5a09] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:53:26.335669 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:26.336352 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:26.344959 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] [instance: 0e2f6f96-67df-403a-8dd1-d9fcf7ca5a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:53:26.346931 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:26.347590 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:26.410761 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:26.411287 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5d1ec49c-7859-45b5-9151-fc862ef7682a tempest-ServersTestJSON-1361174571 tempest-ServersTestJSON-1361174571-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:28.979702 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:53:29.025316 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:29.026186 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:29.153934 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:29.155178 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:29.156115 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:29.157574 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:29.197850 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Getting quotas for project 1dc104cdfbba4a8a9c2a21becb23376c. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:53:29.205116 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Getting quotas for user 6050e51ced8f4dd0aef7203702ede37b and project 1dc104cdfbba4a8a9c2a21becb23376c. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:53:29.218770 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] [instance: 3f1a8701-4159-4fc4-81b9-ae2502ea730e] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:53:29.220578 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:29.221246 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:29.230939 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] [instance: 3f1a8701-4159-4fc4-81b9-ae2502ea730e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:53:29.232955 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:29.233741 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:29.275135 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:29.276158 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-3ede4e77-d534-455f-b639-4d4552fa2565 tempest-VolumesAdminNegativeTest-279177371 tempest-VolumesAdminNegativeTest-279177371-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:47.443514 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:53:47.468305 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:47.471085 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:47.525615 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:47.526406 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:47.527446 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:47.528128 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:47.550245 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Getting quotas for project 81a5120bbc634d2c9b4edc349f39735b. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:53:47.555146 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Getting quotas for user f4ca09eb92304c40ac54b0f36576fd9b and project 81a5120bbc634d2c9b4edc349f39735b. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:53:47.568680 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] [instance: d73b65e1-0e57-49d2-bc9e-fe2e2232b9ba] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:53:47.570134 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:47.570926 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:47.582261 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] [instance: d73b65e1-0e57-49d2-bc9e-fe2e2232b9ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:53:47.584211 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:47.584860 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:47.655484 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:53:47.656109 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-28a8f442-57be-4823-8a8d-1f7fbd45d951 tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:53:59.975297 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:54:00.000708 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:00.001222 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:00.084410 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:00.085919 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:00.086855 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:00.087361 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:00.120287 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Getting quotas for project 1703005927964cdca97bf7eae74e916b. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:54:00.132692 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Getting quotas for user 23c20b9f4bba4cf4aad1e447994d2ef6 and project 1703005927964cdca97bf7eae74e916b. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:54:00.166091 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] [instance: cd57a425-7b2e-40cf-9087-3349f05df07d] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:54:00.167387 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:00.168113 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:00.177377 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] [instance: cd57a425-7b2e-40cf-9087-3349f05df07d] block_device_mapping [BlockDeviceMapping(attachment_id=d9ff9e8d-b819-480c-97c2-008a691c16b0,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='226632de-d63b-40cf-81d8-884c3fb82521',volume_size=1,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:54:00.179366 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:00.180230 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:00.220853 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:00.221460 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1313d975-84eb-4d6d-b508-936b44feb7ae tempest-ServersTestBootFromVolume-1399288644 tempest-ServersTestBootFromVolume-1399288644-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:05.692056 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:54:05.731935 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:05.732461 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:05.811611 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:05.812216 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:05.813244 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:05.813802 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:05.839990 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:54:05.846943 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for user 7b9cd670af614cb3935f05e877b91d06 and project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:54:05.867415 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 5078f84c-fca5-4d7e-91be-42533de5d2cb] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:54:05.870135 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:05.871961 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:05.884667 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 5078f84c-fca5-4d7e-91be-42533de5d2cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:54:05.886144 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:05.886798 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:05.957030 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:05.957690 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:54:05.958204 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3d231443-09d4-45fa-81a0-171218501afe tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:05.989597 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:05.990157 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:06.048877 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:06.049615 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:06.051267 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:06.051953 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:06.092946 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Getting quotas for project ec5f7b1999e14e269c73708174e40a14. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:54:06.102576 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Getting quotas for user 0ad48078fa6f44c39e8e0ef8ab0ff63e and project ec5f7b1999e14e269c73708174e40a14. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:54:06.139616 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] [instance: ca807a27-c2cc-4cc8-be12-0f29e327b4ae] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:54:06.139616 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:06.139616 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:06.154800 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] [instance: ca807a27-c2cc-4cc8-be12-0f29e327b4ae] block_device_mapping [BlockDeviceMapping(attachment_id=d41da0f7-5ec7-4b62-af78-ce5381d15ae1,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='acea8e5c-cf9e-4fdc-9b7b-abd249e6c405',volume_size=1,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:54:06.171779 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:06.171779 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:06.217206 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:06.217743 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-119b33c3-012d-40a0-97b6-c537867c63f4 tempest-LiveMigrationTest-1032357258 tempest-LiveMigrationTest-1032357258-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:08.938372 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:54:08.994131 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:08.995095 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:09.101426 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:09.101996 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:09.102831 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:09.103350 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:09.148545 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Getting quotas for project 075746a3ea344885bf5424df569c7a35. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:54:09.161235 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Getting quotas for user 0eba5a0e4895497daf850df5d61d7951 and project 075746a3ea344885bf5424df569c7a35. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:54:09.189206 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 79164d71-6d47-48a5-87d5-68693d679649] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:54:09.190545 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:09.191466 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:09.205939 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] [instance: 79164d71-6d47-48a5-87d5-68693d679649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:54:09.208134 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:09.208851 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:09.267086 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:09.267675 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-40486964-370e-4a8c-ae53-98f3dcec1c5c tempest-MigrationsAdminTest-783375705 tempest-MigrationsAdminTest-783375705-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:15.545041 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 14:54:28.346242 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:54:28.412678 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:28.416180 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:28.536795 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:28.538659 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:28.540488 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:28.543725 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:28.572874 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:54:28.580705 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for user 7b9cd670af614cb3935f05e877b91d06 and project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:54:28.606543 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 6c4205dd-35c1-4a14-b03a-6cbd70b83c58] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:54:28.609016 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:28.609690 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:28.622732 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 6c4205dd-35c1-4a14-b03a-6cbd70b83c58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:54:28.625702 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:28.627836 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:28.695521 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:28.697024 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ae0352b3-3eec-4550-8c94-d9cb3758af6f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:31.634448 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c4535646-5738-4d27-bfa2-983ed36e8e1f tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:54:31.635047 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c4535646-5738-4d27-bfa2-983ed36e8e1f tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:31.635780 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c4535646-5738-4d27-bfa2-983ed36e8e1f tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:32.084473 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-c4535646-5738-4d27-bfa2-983ed36e8e1f tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Created allocations for migration caa1e727-1ada-4424-bceb-f1cecdcc8daf on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:54:32.252811 n-d-819181-1 nova-conductor[89840]: DEBUG nova.scheduler.utils [None req-c4535646-5738-4d27-bfa2-983ed36e8e1f tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] [instance: d73b65e1-0e57-49d2-bc9e-fe2e2232b9ba] Instance allocations successfully created on destination node 8cc92976-9961-443c-adea-bbeeebbf35b2: {'allocations': {'8cc92976-9961-443c-adea-bbeeebbf35b2': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89840) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Nov 25 14:54:32.253297 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-c4535646-5738-4d27-bfa2-983ed36e8e1f tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lazy-loading 'resources' on Instance uuid d73b65e1-0e57-49d2-bc9e-fe2e2232b9ba {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:54:32.258091 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-c4535646-5738-4d27-bfa2-983ed36e8e1f tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lazy-loading 'pci_requests' on Instance uuid d73b65e1-0e57-49d2-bc9e-fe2e2232b9ba {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:54:32.675766 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.live_migrate [None req-c4535646-5738-4d27-bfa2-983ed36e8e1f tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] [instance: d73b65e1-0e57-49d2-bc9e-fe2e2232b9ba] Start binding ports on destination host: n-h1-819181-1 {{(pid=89840) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Nov 25 14:54:39.255082 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-5dcb1f9b-51e2-4023-84fb-2d0f2787ee49 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:54:39.257260 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5dcb1f9b-51e2-4023-84fb-2d0f2787ee49 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:39.259719 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5dcb1f9b-51e2-4023-84fb-2d0f2787ee49 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:39.629544 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-5dcb1f9b-51e2-4023-84fb-2d0f2787ee49 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] [instance: 79164d71-6d47-48a5-87d5-68693d679649] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89841) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 14:54:40.276431 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-5dcb1f9b-51e2-4023-84fb-2d0f2787ee49 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] Created allocations for migration 8e504d78-4347-44b1-9f92-000d896deebb on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:54:40.657213 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-5dcb1f9b-51e2-4023-84fb-2d0f2787ee49 tempest-MigrationsAdminTest-371025250 tempest-MigrationsAdminTest-371025250-project-admin] [instance: 79164d71-6d47-48a5-87d5-68693d679649] Calling prep_resize with selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89841) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 14:54:42.728586 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ed0bd38b-1ac7-4be1-b1ed-d506b9b3dda2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:54:42.729202 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed0bd38b-1ac7-4be1-b1ed-d506b9b3dda2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:42.729583 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed0bd38b-1ac7-4be1-b1ed-d506b9b3dda2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:43.088872 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-ed0bd38b-1ac7-4be1-b1ed-d506b9b3dda2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Created allocations for migration 6c780186-ddd7-4c70-b33b-858ac18745eb on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:54:43.211882 n-d-819181-1 nova-conductor[89840]: DEBUG nova.scheduler.utils [None req-ed0bd38b-1ac7-4be1-b1ed-d506b9b3dda2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] [instance: ca807a27-c2cc-4cc8-be12-0f29e327b4ae] Instance allocations successfully created on destination node c70a3c4d-08ee-470c-b8da-baacf1e5a82b: {'allocations': {'c70a3c4d-08ee-470c-b8da-baacf1e5a82b': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=89840) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Nov 25 14:54:43.212637 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-ed0bd38b-1ac7-4be1-b1ed-d506b9b3dda2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lazy-loading 'resources' on Instance uuid ca807a27-c2cc-4cc8-be12-0f29e327b4ae {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:54:43.218715 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-ed0bd38b-1ac7-4be1-b1ed-d506b9b3dda2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] Lazy-loading 'pci_requests' on Instance uuid ca807a27-c2cc-4cc8-be12-0f29e327b4ae {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:54:43.631344 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.live_migrate [None req-ed0bd38b-1ac7-4be1-b1ed-d506b9b3dda2 tempest-LiveMigrationTest-995233400 tempest-LiveMigrationTest-995233400-project-admin] [instance: ca807a27-c2cc-4cc8-be12-0f29e327b4ae] Start binding ports on destination host: n-h2-819181-1 {{(pid=89840) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Nov 25 14:54:44.007205 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:54:44.063965 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:44.064375 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:44.201557 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:44.201557 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:44.208110 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:44.208110 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:44.258471 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Getting quotas for project 9d45d0d2adad44b0b38d20e6e510da16. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:54:44.271488 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Getting quotas for user c98c1c9912be4c98898902bd4e87146d and project 9d45d0d2adad44b0b38d20e6e510da16. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:54:44.307754 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] [instance: 17cde0ad-4285-4752-a3c6-8d74aa1432b9] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:54:44.307754 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:44.307754 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:44.344715 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] [instance: 17cde0ad-4285-4752-a3c6-8d74aa1432b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:54:44.344715 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:44.348384 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:54:44.451280 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:54:44.451702 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-76a46f40-c03f-46ff-a028-09c86f509a40 tempest-FloatingIPsAssociationNegativeTestJSON-461997949 tempest-FloatingIPsAssociationNegativeTestJSON-461997949-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:15.511990 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:55:15.619241 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:15.619241 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:15.749185 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:15.749615 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:15.750490 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:15.751684 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:15.778643 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:55:15.782710 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for user 7b9cd670af614cb3935f05e877b91d06 and project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:55:15.796412 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 5dabe78d-ed6f-4304-b3f6-c7399f82d75c] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:55:15.797397 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:15.798066 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:15.810225 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 5dabe78d-ed6f-4304-b3f6-c7399f82d75c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:55:15.811254 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:15.811254 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:15.868239 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:15.868623 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7d372948-61f7-4ac6-8eec-2eda51fd3d04 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:19.132455 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 14:55:20.153735 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55104. Nov 25 14:55:44.594705 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:55:44.623753 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:44.624164 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:44.671808 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:44.673709 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:44.674369 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:44.675264 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:44.696309 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:55:44.701149 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for user 7b9cd670af614cb3935f05e877b91d06 and project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:55:44.712459 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 25aa5d22-8c66-4be3-9092-d177efd46be0] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:55:44.713487 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:44.713897 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:44.721878 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 25aa5d22-8c66-4be3-9092-d177efd46be0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:55:44.723474 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:44.724020 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:44.760083 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:44.760563 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a9e1e533-5b34-487a-8237-0e539baadf2a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:48.111312 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:55:48.139933 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:48.140754 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:48.191161 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:48.191747 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:48.192828 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:48.193385 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:48.212299 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Getting quotas for project 81a5120bbc634d2c9b4edc349f39735b. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:55:48.217229 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Getting quotas for user f4ca09eb92304c40ac54b0f36576fd9b and project 81a5120bbc634d2c9b4edc349f39735b. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:55:48.227824 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] [instance: ecbc8f32-f30a-4b7d-b51f-3413a55735b9] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:55:48.229567 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:48.230262 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:48.237818 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] [instance: ecbc8f32-f30a-4b7d-b51f-3413a55735b9] block_device_mapping [BlockDeviceMapping(attachment_id=9b89a74e-022a-47f6-a734-29f062598de4,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1963852d-1fab-4ad3-8279-e1143bc0a9a1',volume_size=1,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:55:48.239156 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:48.239568 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:55:48.268256 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:55:48.268750 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3286ab5-f5db-445e-a7f0-1814a9ee1e3e tempest-LiveAutoBlockMigrationV225Test-1318645502 tempest-LiveAutoBlockMigrationV225Test-1318645502-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:18.036705 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ee548b54-226d-4124-bed7-1398fea6c5aa tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 14:56:18.037290 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ee548b54-226d-4124-bed7-1398fea6c5aa tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:18.037900 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ee548b54-226d-4124-bed7-1398fea6c5aa tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:18.879304 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-ee548b54-226d-4124-bed7-1398fea6c5aa tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Created allocations for migration 652d610c-525b-46d9-8215-02be34178fcd on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 14:56:19.262326 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:56:19.306058 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:19.306058 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:19.460860 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:19.460860 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:19.460860 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:19.460860 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:19.510141 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:56:19.524402 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for user 8504648a68c24728b479900614ec5699 and project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:56:19.560355 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 46da4531-7322-4811-aba7-caa66510cff7] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:56:19.560355 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:19.560355 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:19.573532 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 46da4531-7322-4811-aba7-caa66510cff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:56:19.573532 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:19.573532 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:19.602302 n-d-819181-1 nova-conductor[89841]: DEBUG nova.scheduler.utils [None req-ee548b54-226d-4124-bed7-1398fea6c5aa tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] [instance: ecbc8f32-f30a-4b7d-b51f-3413a55735b9] Instance allocations successfully created on destination node 8cc92976-9961-443c-adea-bbeeebbf35b2: {'allocations': {'8cc92976-9961-443c-adea-bbeeebbf35b2': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=89841) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Nov 25 14:56:19.602302 n-d-819181-1 nova-conductor[89841]: DEBUG nova.objects.instance [None req-ee548b54-226d-4124-bed7-1398fea6c5aa tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lazy-loading 'resources' on Instance uuid ecbc8f32-f30a-4b7d-b51f-3413a55735b9 {{(pid=89841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:56:19.612688 n-d-819181-1 nova-conductor[89841]: DEBUG nova.objects.instance [None req-ee548b54-226d-4124-bed7-1398fea6c5aa tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] Lazy-loading 'pci_requests' on Instance uuid ecbc8f32-f30a-4b7d-b51f-3413a55735b9 {{(pid=89841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 14:56:19.665365 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:19.665365 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9bd85afc-0862-4a6d-a203-744b527e558a tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:20.198221 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.live_migrate [None req-ee548b54-226d-4124-bed7-1398fea6c5aa tempest-LiveAutoBlockMigrationV225Test-18722905 tempest-LiveAutoBlockMigrationV225Test-18722905-project-admin] [instance: ecbc8f32-f30a-4b7d-b51f-3413a55735b9] Start binding ports on destination host: n-h1-819181-1 {{(pid=89841) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Nov 25 14:56:25.683177 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:56:25.749723 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:25.757654 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:25.832071 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:25.833139 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:25.834061 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:25.834640 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:25.878764 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:56:25.897743 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for user 7b9cd670af614cb3935f05e877b91d06 and project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:56:25.927970 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 8c5be902-82ac-477a-ba52-ac4b18388346] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:56:25.930412 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:25.932655 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:25.948058 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 8c5be902-82ac-477a-ba52-ac4b18388346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:56:25.951162 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:25.953095 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:26.038648 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:26.040990 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ad4dac97-818e-4782-8bba-ec2a9f9b127a tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:48.881532 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:56:48.931177 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:48.931998 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:49.066196 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:49.066998 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:49.068305 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:49.069048 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:49.103816 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Getting quotas for project 386dc9c25b76427cbe81d48b5a114a2a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:56:49.114485 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Getting quotas for user 9e294d52167543f29726e703d4d6de8d and project 386dc9c25b76427cbe81d48b5a114a2a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:56:49.150521 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] [instance: 579e3f21-ad2a-4ead-a7a3-661fbe6572f4] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:56:49.152198 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:49.152972 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:49.167094 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] [instance: 579e3f21-ad2a-4ead-a7a3-661fbe6572f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:56:49.172676 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:49.175989 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:56:49.267706 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:56:49.268728 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-78383137-c444-40f2-9c9d-be71c12581d1 tempest-ImagesOneServerTestJSON-1566213701 tempest-ImagesOneServerTestJSON-1566213701-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:01.770215 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 14:57:02.807176 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56666. Nov 25 14:57:04.746728 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:57:04.787110 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:04.789708 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:04.908814 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:04.909587 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:04.910558 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:04.911171 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:04.952078 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Getting quotas for project 2e5373e4b8554a25be051b20bfa6213d. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:57:04.957906 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Getting quotas for user 03022ec693524b26a415f9fb2b4a54cc and project 2e5373e4b8554a25be051b20bfa6213d. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:57:04.982376 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] [instance: 4fbd6f06-c5eb-42ff-a6b9-4dcb01b39b7f] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:57:04.982849 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:04.983254 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:04.999489 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] [instance: 4fbd6f06-c5eb-42ff-a6b9-4dcb01b39b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:57:05.001203 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:05.001848 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:05.054255 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:05.054806 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-27b1df2e-6c08-4f80-81cf-1209cd9d0be1 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:11.918756 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:57:11.943739 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:11.944390 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:12.002834 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:12.003243 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:12.003958 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:12.004350 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:12.020510 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Getting quotas for project a413a9390d884759bfcb4f201aca6751. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:57:12.025819 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Getting quotas for user 2ed8c9de2ab94cd3b5e1107473703a31 and project a413a9390d884759bfcb4f201aca6751. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:57:12.036484 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] [instance: c980b1c7-8fe1-468d-b84c-ec99a9915ed1] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:57:12.037460 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:12.037862 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:12.044835 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] [instance: c980b1c7-8fe1-468d-b84c-ec99a9915ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:57:12.046125 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:12.046597 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:12.103981 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:12.104791 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f87163c7-73b6-4066-84f6-644725f57055 tempest-ServersTestManualDisk-2061535879 tempest-ServersTestManualDisk-2061535879-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:13.353620 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:13.354101 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.025187 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Took 0.59 seconds to select destinations for 2 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:57:14.068969 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.068969 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.129896 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.130685 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.203251 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.203660 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.204394 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.204935 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.235858 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:57:14.252342 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for user 8504648a68c24728b479900614ec5699 and project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:57:14.288674 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: c78955aa-7bbc-41de-a447-9107bfbc058a] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:57:14.290825 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.292093 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.303685 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: c78955aa-7bbc-41de-a447-9107bfbc058a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:57:14.305832 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.306379 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.370903 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.371506 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.388707 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 76a9b5d3-eed5-4cf4-b7ef-0f5f40a54a99] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:57:14.390455 n-d-819181-1 nova-conductor[89841]: DEBUG nova.objects.instance_group [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lazy-loading 'hosts' on InstanceGroup uuid b21ef12c-29ca-4d23-8e06-c1da850b376b {{(pid=89841) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Nov 25 14:57:14.427514 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.427963 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.444254 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 76a9b5d3-eed5-4cf4-b7ef-0f5f40a54a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:57:14.446846 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.447275 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:14.505023 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:14.505449 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ac86e2eb-6880-4ab4-acf1-4fcdf217f76c tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:25.173913 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:57:25.234858 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:25.235278 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:25.400846 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:25.401727 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:25.402041 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:25.404233 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:25.477319 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Getting quotas for project 6484e338a0c947dca9bad15a71a1ee9d. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:57:25.487651 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Getting quotas for user 92d1994d668a4c3f98a10450de98bf02 and project 6484e338a0c947dca9bad15a71a1ee9d. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:57:25.509051 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] [instance: a06fb390-2456-47b2-acc9-c9a5752975ac] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:57:25.510057 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:25.510469 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:25.527980 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] [instance: a06fb390-2456-47b2-acc9-c9a5752975ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:57:25.529398 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:25.529828 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:25.599339 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:57:25.599745 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-84c2e016-78b6-411c-9e7b-b3c0bfabfc7e tempest-InstanceActionsNegativeTestJSON-1084658998 tempest-InstanceActionsNegativeTestJSON-1084658998-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:57:35.581396 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 14:58:03.403181 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:03.403713 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:03.902963 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Took 0.44 seconds to select destinations for 2 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:58:03.960446 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:03.961052 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:04.158886 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:04.164099 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:04.251108 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:04.251620 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:04.252605 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:04.253468 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:04.282169 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:58:04.290679 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for user 8504648a68c24728b479900614ec5699 and project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:58:04.306808 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 85e29d02-c31d-490f-a36e-fd71fb183015] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:58:04.309441 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:04.310202 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:04.324050 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 85e29d02-c31d-490f-a36e-fd71fb183015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:58:04.329818 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:04.333664 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:04.411112 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:04.412967 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:04.434875 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 05d85ed0-8a48-44a2-800b-7308743993b4] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:58:04.437559 n-d-819181-1 nova-conductor[89841]: DEBUG nova.objects.instance_group [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lazy-loading 'hosts' on InstanceGroup uuid 08a8c6a8-2a51-4ed4-9400-a1f659992e36 {{(pid=89841) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Nov 25 14:58:04.470386 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:04.475043 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:04.492262 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 05d85ed0-8a48-44a2-800b-7308743993b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:58:04.495793 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:04.496272 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:04.556799 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:04.557384 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-da636084-f354-4fbf-829c-916d5c06efeb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:09.875206 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:58:09.904431 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:09.905208 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:09.956657 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:09.957355 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:09.958311 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:09.959769 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:10.004393 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Getting quotas for project 2e5373e4b8554a25be051b20bfa6213d. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:58:10.023935 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Getting quotas for user 03022ec693524b26a415f9fb2b4a54cc and project 2e5373e4b8554a25be051b20bfa6213d. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:58:10.046227 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] [instance: b43f150c-9666-4df7-922a-3319a1b67066] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:58:10.047212 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:10.047631 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:10.063225 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] [instance: b43f150c-9666-4df7-922a-3319a1b67066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:58:10.064546 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:10.064971 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:10.121306 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:10.121779 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3732b97d-4683-45a0-9edf-97ed726f7d14 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:20.154510 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 14:58:21.172363 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57908. Nov 25 14:58:23.578958 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:58:23.601830 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:23.602502 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:23.667925 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:23.668449 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:23.669992 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:23.670546 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:23.691248 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Getting quotas for project 5503bd0ed74a4901bf4cc5ed36a1be6f. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:58:23.698392 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Getting quotas for user 810eb20de9e346f4abe46be82ba969aa and project 5503bd0ed74a4901bf4cc5ed36a1be6f. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:58:23.711781 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] [instance: 0af7a199-472d-49ff-959c-2dc65a23bf6b] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:58:23.713187 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:23.713991 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:23.725411 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] [instance: 0af7a199-472d-49ff-959c-2dc65a23bf6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:58:23.727421 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:23.728135 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:23.829103 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:23.829934 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1667adb9-165b-4235-a25d-864063c200d8 tempest-ServerAddressesNegativeTestJSON-1228487029 tempest-ServerAddressesNegativeTestJSON-1228487029-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:39.887760 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Took 1.25 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:58:39.976226 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:39.976638 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:40.076190 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:40.080167 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:40.081197 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:40.081814 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:40.107323 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:58:40.120393 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for user 7b9cd670af614cb3935f05e877b91d06 and project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:58:40.158556 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: a498e2ac-3aa2-48d8-b49f-1891941a2e27] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:58:40.159520 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:40.159919 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:40.185709 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: a498e2ac-3aa2-48d8-b49f-1891941a2e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:58:40.195620 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:40.200522 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:40.274845 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:40.275509 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-45287af5-5b34-4ef4-ac51-6577b582495f tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:52.263718 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:58:52.290898 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:52.291560 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:52.353798 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:52.356013 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:52.358530 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:52.359506 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:52.398793 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:58:52.403876 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for user 8504648a68c24728b479900614ec5699 and project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:58:52.420625 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 8a83515e-2019-48a8-8918-5fdf780eb581] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:58:52.420625 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:52.420625 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:52.426123 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 8a83515e-2019-48a8-8918-5fdf780eb581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:58:52.427474 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:52.427884 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:58:52.462356 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:58:52.463050 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a308e55a-0c03-486a-b3cc-31d6d3a18643 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:08.939154 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:59:08.974940 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:08.975501 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:09.044871 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:09.045436 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:09.046255 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:09.046830 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:09.071914 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Getting quotas for project 04c7719cb9c24246a1b5d113352fd5f6. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:59:09.080056 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Getting quotas for user 0a74d693a3984a6186d37358267951bb and project 04c7719cb9c24246a1b5d113352fd5f6. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:59:09.099596 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] [instance: 5033a4b5-bfc5-4b9a-9eb8-1939a4225ecd] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:59:09.101104 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:09.102832 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:09.117111 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] [instance: 5033a4b5-bfc5-4b9a-9eb8-1939a4225ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:59:09.118708 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:09.119327 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:09.180208 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:09.180707 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5e3b2236-60e7-4a37-a7aa-b414db0cb8c5 tempest-ImagesNegativeTestJSON-362556446 tempest-ImagesNegativeTestJSON-362556446-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:16.259777 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:59:16.290220 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:16.290896 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:16.384873 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:16.384873 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:16.385270 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:16.385659 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:16.420618 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:59:16.425834 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for user 8504648a68c24728b479900614ec5699 and project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:59:16.445800 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: fcd88aa0-ab67-4d20-aaea-1000c07bc150] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:59:16.447619 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:16.448038 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:16.459289 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: fcd88aa0-ab67-4d20-aaea-1000c07bc150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:59:16.460747 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:16.461239 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:16.539239 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:16.539679 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2d45408f-51a7-4f73-a735-c6fc001ba491 tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:28.871985 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:59:28.920352 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:28.922963 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:29.000838 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:29.001533 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:29.002800 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:29.003515 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:29.024793 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Getting quotas for project 58a2f302a81d4e7eac4198d756386e64. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:59:29.030114 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Getting quotas for user 22c6ce7d1a2741938a40fc36750f2250 and project 58a2f302a81d4e7eac4198d756386e64. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:59:29.042775 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] [instance: dfc66626-eb9c-481f-b1f4-1b79b2be3acc] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:59:29.043728 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:29.044136 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:29.052934 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] [instance: dfc66626-eb9c-481f-b1f4-1b79b2be3acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:59:29.054303 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:29.054714 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:29.110431 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:29.110875 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b98ebfb0-581e-4b0d-8bd6-4c61da03d2ce tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:39.416364 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:59:39.464287 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:39.464936 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:39.545850 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:39.546556 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:39.547496 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:39.548121 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:39.569528 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Getting quotas for project c6698c02eaf444cf85335474814371f7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:59:39.575640 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Getting quotas for user 4f272878bd87438db2996f10a76c702f and project c6698c02eaf444cf85335474814371f7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:59:39.591018 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] [instance: adeef71e-ca5c-438e-bd4b-737c3a267af5] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:59:39.592834 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:39.593462 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:39.603765 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] [instance: adeef71e-ca5c-438e-bd4b-737c3a267af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:59:39.611587 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:39.612440 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:39.667090 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:39.667679 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-83d8e116-88a0-4a81-9cc5-527809b359e0 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:43.487793 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:59:43.567501 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:43.570764 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:43.649379 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:43.651118 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:43.652108 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:43.654307 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:43.699589 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:59:43.707204 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Getting quotas for user 8504648a68c24728b479900614ec5699 and project 13372368a16d469ea16d051d449eb861. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:59:43.726755 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 0d717faf-a27e-4bbb-b08d-db9da9619ba6] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:59:43.729430 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:43.730141 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:43.749796 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] [instance: 0d717faf-a27e-4bbb-b08d-db9da9619ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:59:43.751274 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:43.751827 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:43.809097 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:43.809891 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-fd8931d0-c3ee-4e29-bbd5-598fded69ddb tempest-ServersOnMultiNodesTest-1353108549 tempest-ServersOnMultiNodesTest-1353108549-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:45.659211 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 14:59:45.698437 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:45.705982 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:45.796942 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:45.797609 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:45.798486 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:45.799028 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:45.823650 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 14:59:45.829819 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Getting quotas for user 7b9cd670af614cb3935f05e877b91d06 and project b3aa0fc12d08437ba4a14b15337be73a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 14:59:45.843980 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 6cc10dbf-2b3a-49e8-849f-de15994e714a] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 14:59:45.845219 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:45.846457 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:45.860044 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] [instance: 6cc10dbf-2b3a-49e8-849f-de15994e714a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 14:59:45.861666 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:45.863157 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 14:59:45.930768 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 14:59:45.931431 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a334eaa4-85b6-41aa-a0ea-7e077ee5b0b2 tempest-DeleteServersTestJSON-1129652560 tempest-DeleteServersTestJSON-1129652560-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:02.802338 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:00:03.821785 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60270. Nov 25 15:00:05.387092 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:00:05.412673 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:05.413126 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:05.470468 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:05.471134 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:05.473054 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:05.473481 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:05.490938 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Getting quotas for project 2e5373e4b8554a25be051b20bfa6213d. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:00:05.498708 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Getting quotas for user 03022ec693524b26a415f9fb2b4a54cc and project 2e5373e4b8554a25be051b20bfa6213d. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:00:05.510834 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] [instance: 0783a631-11c0-44a3-a7bd-5b651af62b39] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:00:05.511795 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:05.512205 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:05.519865 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] [instance: 0783a631-11c0-44a3-a7bd-5b651af62b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:00:05.521141 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:05.521550 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:05.552784 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:05.553434 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6b463d8b-473e-4196-af65-e045a6a58a0c tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:26.912013 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:00:26.992762 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:26.993215 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:27.197180 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:27.198527 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:27.202018 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:27.203550 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:27.251615 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Getting quotas for project 58a2f302a81d4e7eac4198d756386e64. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:00:27.264926 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Getting quotas for user 22c6ce7d1a2741938a40fc36750f2250 and project 58a2f302a81d4e7eac4198d756386e64. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:00:27.295997 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] [instance: 8b756848-1d51-473c-9ad6-1857f6fb14d1] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:00:27.299376 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:27.301120 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:27.318007 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] [instance: 8b756848-1d51-473c-9ad6-1857f6fb14d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:00:27.320091 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:27.320803 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:27.383145 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:27.383638 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a5661540-92ef-4fe1-bde2-b9cc9a319e75 tempest-SecurityGroupsTestJSON-437410449 tempest-SecurityGroupsTestJSON-437410449-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:40.418060 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:00:40.502704 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:40.503119 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:40.609484 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:40.611678 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:40.613158 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:40.614893 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:40.638788 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Getting quotas for project c6698c02eaf444cf85335474814371f7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:00:40.647100 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Getting quotas for user 4f272878bd87438db2996f10a76c702f and project c6698c02eaf444cf85335474814371f7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:00:40.670504 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] [instance: a34a9950-4736-4139-b4a2-01877cf3b1ea] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:00:40.671865 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:40.672621 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:40.689714 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] [instance: a34a9950-4736-4139-b4a2-01877cf3b1ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:00:40.691363 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:40.691907 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:40.733939 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:00:40.737924 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-49b7471b-67e3-40d5-a6c1-da795d5c93a9 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:00:55.608399 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:01:00.558790 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:00.559333 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:00.984137 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:01:01.021362 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:01.021780 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:01.088965 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:01.089519 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:01.090384 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:01.090862 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:01.112422 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Getting quotas for project 553cf4df1aee4158875f95fe0691929c. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:01:01.117761 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Getting quotas for user d062194fc7ee41e186a385f447646027 and project 553cf4df1aee4158875f95fe0691929c. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:01:01.132912 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] [instance: d9e09701-1330-4836-8a8a-099edfa7889a] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:01:01.134325 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:01.135106 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:01.147580 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] [instance: d9e09701-1330-4836-8a8a-099edfa7889a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:01:01.150646 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:01.151301 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:01.217415 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:01.218260 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e8c14bfe-9875-4a94-a575-7a4616484cd1 tempest-ServerGroupTestJSON-745097313 tempest-ServerGroupTestJSON-745097313-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:10.575871 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:01:10.635894 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:10.636323 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:10.713579 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:10.714514 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:10.715566 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:10.716255 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:10.744046 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Getting quotas for project 2e5373e4b8554a25be051b20bfa6213d. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:01:10.757512 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Getting quotas for user 03022ec693524b26a415f9fb2b4a54cc and project 2e5373e4b8554a25be051b20bfa6213d. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:01:10.787280 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] [instance: 581c2e07-b577-487c-a795-d5e05f225f9e] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:01:10.788243 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:10.788645 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:10.802198 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] [instance: 581c2e07-b577-487c-a795-d5e05f225f9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:01:10.803487 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:10.803903 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:10.850575 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:10.850996 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-df83b52c-f973-4d3b-8143-c90945dfa113 tempest-ImagesTestJSON-1446063321 tempest-ImagesTestJSON-1446063321-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:21.181676 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:01:22.201954 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33866. Nov 25 15:01:34.772408 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:01:34.831633 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:34.839937 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:34.926271 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:34.926927 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:34.927825 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:34.928371 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:34.947492 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Getting quotas for project c6698c02eaf444cf85335474814371f7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:01:34.959895 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Getting quotas for user 4f272878bd87438db2996f10a76c702f and project c6698c02eaf444cf85335474814371f7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:01:34.985269 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] [instance: 64cad0fa-8fc9-486b-857c-1cae3f44265b] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:01:34.991804 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:34.991804 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:35.009929 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] [instance: 64cad0fa-8fc9-486b-857c-1cae3f44265b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:01:35.011151 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:35.011594 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:35.067247 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:35.067688 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a6a2cfff-e34d-4bf8-93c6-c2d2d17a4f70 tempest-ImagesOneServerNegativeTestJSON-1344579766 tempest-ImagesOneServerNegativeTestJSON-1344579766-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:58.237895 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:01:58.291050 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:58.291727 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:58.402613 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:58.402871 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:58.404212 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:58.412510 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:58.442804 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Getting quotas for project 062a0df38ba14218b0071ea5924c6e3b. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:01:58.450347 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Getting quotas for user 1e8a10b302fb457d80ab078673aa8a9f and project 062a0df38ba14218b0071ea5924c6e3b. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:01:58.465961 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] [instance: 29645913-1ab1-4609-8848-79d4d93be8a4] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:01:58.467217 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:58.468302 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:58.477810 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] [instance: 29645913-1ab1-4609-8848-79d4d93be8a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:01:58.480234 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:58.480953 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:01:58.526591 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:01:58.527877 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-0b22f64b-0476-42c5-a2fa-ed6be33b1b31 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:06.820292 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-838a056a-e039-468c-8115-2619ef6ecec6 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method rebuild_instance {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:02:06.821510 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-838a056a-e039-468c-8115-2619ef6ecec6 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:06.822442 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-838a056a-e039-468c-8115-2619ef6ecec6 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:06.851208 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-838a056a-e039-468c-8115-2619ef6ecec6 tempest-ServerShowV257Test-1714810046 tempest-ServerShowV257Test-1714810046-project] [instance: 29645913-1ab1-4609-8848-79d4d93be8a4] No migration record for the rebuild/evacuate request. {{(pid=89841) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Nov 25 15:02:10.263387 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:02:10.313214 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:10.313639 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:10.418173 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:10.418953 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:10.419930 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:10.420559 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:10.439277 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Getting quotas for project 628776ba32924602850ec9cd10ca9433. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:02:10.452762 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Getting quotas for user 5ec918f821f042229cc39c10e9956910 and project 628776ba32924602850ec9cd10ca9433. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:02:10.486513 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] [instance: 0d38fcef-0a32-4f27-9c2a-f2b0ee6139ff] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:02:10.488761 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:10.489206 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:10.510357 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] [instance: 0d38fcef-0a32-4f27-9c2a-f2b0ee6139ff] block_device_mapping [BlockDeviceMapping(attachment_id=26723514-e557-48e2-8ec4-64f3f139d4ec,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='07fc620a-cbc6-4416-b1d2-0403ee1214b7',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=bcf8b2c1-cdac-4d9c-9a80-8e2c44e71bed,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1dad9b70-045d-4a6b-ba4b-ceff3ae6ddea',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=1eef1b8f-b51a-4fe8-9a27-4d408782f980,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c066ed20-c88b-4ac3-a394-d102564518fe',volume_size=1,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:02:10.513337 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:10.514317 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:10.547912 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:10.548706 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:10.563065 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:10.563897 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:10.614317 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:10.614869 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3271da56-d0c2-4727-b1ee-c2d6dd1703d5 tempest-TaggedBootDevicesTest-733908774 tempest-TaggedBootDevicesTest-733908774-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:11.268099 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:02:11.317536 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:11.318598 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:11.484534 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:11.485459 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:11.488794 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:11.489557 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:11.532425 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Getting quotas for project 0f81ae837a164d35a783f3593af3c6a3. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:02:11.550035 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Getting quotas for user 99b62c8dcac14903972c978377a13650 and project 0f81ae837a164d35a783f3593af3c6a3. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:02:11.579912 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] [instance: c505340b-dc6e-4b0c-ac56-4aaec49d7f3c] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:02:11.581408 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:11.581816 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:11.594995 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] [instance: c505340b-dc6e-4b0c-ac56-4aaec49d7f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:02:11.599038 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:11.601010 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:11.687706 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:11.696694 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1387cc74-f7fb-46f9-b989-9443c208cab2 tempest-ServerAddressesTestJSON-1870194490 tempest-ServerAddressesTestJSON-1870194490-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:13.744472 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:02:13.790786 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:13.791556 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:13.900094 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:13.900817 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:13.901851 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:13.902485 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:13.947259 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Getting quotas for project 21bcb45f88844f58a9eadb5ab4fa66eb. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:02:13.954391 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Getting quotas for user 8663224a7e78464fa404561dc8304161 and project 21bcb45f88844f58a9eadb5ab4fa66eb. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:02:13.978423 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] [instance: ecf2e727-27ad-41ff-9e67-6edbbb7b6222] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:02:13.979842 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:13.980313 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:13.996467 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] [instance: ecf2e727-27ad-41ff-9e67-6edbbb7b6222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:02:13.998508 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:13.999217 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:14.052531 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:14.054066 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f7647e24-7ccf-4e09-a68a-8f5f14c7724d tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:15.844651 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:02:15.870004 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:15.870694 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:15.942478 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:15.943145 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:15.944029 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:15.945018 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:15.974564 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Getting quotas for project 21bcb45f88844f58a9eadb5ab4fa66eb. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:02:15.980296 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Getting quotas for user 8663224a7e78464fa404561dc8304161 and project 21bcb45f88844f58a9eadb5ab4fa66eb. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:02:15.994656 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] [instance: b4c9cd16-ec48-4ce9-b89f-dd9c3a18ef8c] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:02:15.995900 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:15.996465 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:16.008197 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] [instance: b4c9cd16-ec48-4ce9-b89f-dd9c3a18ef8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:02:16.009840 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:16.010406 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:16.079519 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:16.080240 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-37a0d7ec-e94c-454b-83af-9716c751a6c6 tempest-ListImageFiltersTestJSON-179889621 tempest-ListImageFiltersTestJSON-179889621-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:30.410835 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:02:30.455521 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:30.456262 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:30.579995 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:30.590721 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:30.592326 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:30.592901 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:30.627571 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Getting quotas for project 3e6fee2e52c44b0fb0e26fa1719a03be. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:02:30.637574 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Getting quotas for user f75f7c53ee39431ab41d29673766516d and project 3e6fee2e52c44b0fb0e26fa1719a03be. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:02:30.654932 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] [instance: 537b61e2-90d0-4eb8-9b1d-b1b9630906c5] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:02:30.656730 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:30.661349 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:30.681217 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] [instance: 537b61e2-90d0-4eb8-9b1d-b1b9630906c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:02:30.682569 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:30.683056 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:02:30.743405 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:02:30.744157 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1042681c-e566-4df7-8127-cf5ce6ffe792 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:00.503585 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:03:00.543494 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:00.544100 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:00.649663 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:00.650930 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:00.656661 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:00.657291 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:00.700209 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Getting quotas for project 51a6f27e831045b29356b977f2462c6e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:03:00.705932 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Getting quotas for user bdc18371a9cd4c4ca59828db40d61fc5 and project 51a6f27e831045b29356b977f2462c6e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:03:00.729084 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] [instance: de5179bc-d1c3-4d8b-8beb-dba1f2793ab2] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:03:00.730086 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:00.730528 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:00.748735 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] [instance: de5179bc-d1c3-4d8b-8beb-dba1f2793ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:03:00.750082 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:00.750499 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:00.811954 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:00.812370 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-82a81b4a-1cff-42c9-87d5-d907809a138d tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:03.822027 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:03:04.846062 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 36102. Nov 25 15:03:06.938151 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:03:06.992209 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:06.992640 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:07.096036 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:07.096353 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:07.097119 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:07.097718 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:07.147491 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Getting quotas for project 3e6fee2e52c44b0fb0e26fa1719a03be. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:03:07.169100 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Getting quotas for user f75f7c53ee39431ab41d29673766516d and project 3e6fee2e52c44b0fb0e26fa1719a03be. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:03:07.197907 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] [instance: fd38794b-7b68-4e12-82d4-cd017d37db90] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:03:07.199699 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:07.203163 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:07.221389 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] [instance: fd38794b-7b68-4e12-82d4-cd017d37db90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:03:07.223128 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:07.223676 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:07.300537 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:07.301643 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-514fa8ed-9d30-4403-80f3-e60f0e83984f tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:32.374416 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:03:32.399883 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:32.399883 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:32.461518 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:32.461943 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:32.462718 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:32.463114 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:32.482103 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Getting quotas for project 72d4878591d34ea288525621889f3efe. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:03:32.486864 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Getting quotas for user 17958a7f47d0496ea1a857b23b4be629 and project 72d4878591d34ea288525621889f3efe. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:03:32.510154 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] [instance: f90ddbaa-c92a-4dd2-b359-5b79665c6e3d] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:03:32.512296 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:32.512745 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:32.523409 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] [instance: f90ddbaa-c92a-4dd2-b359-5b79665c6e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:03:32.525044 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:32.525486 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:03:32.570280 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:03:32.570950 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-16921068-c73e-4da5-b1ef-b761e46b9069 tempest-ServerRescueTestJSONUnderV235-1803372290 tempest-ServerRescueTestJSONUnderV235-1803372290-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:04:15.658709 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:04:22.203308 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:04:23.223116 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 37354. Nov 25 15:04:35.745902 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:04:35.780363 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:04:35.781390 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:04:35.851099 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:04:35.852730 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:04:35.854169 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:04:35.854829 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:04:35.879912 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Getting quotas for project 51a6f27e831045b29356b977f2462c6e. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:04:35.887281 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Getting quotas for user bdc18371a9cd4c4ca59828db40d61fc5 and project 51a6f27e831045b29356b977f2462c6e. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:04:35.928707 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] [instance: 0eea92e5-adbd-443e-83fe-9cb0f2875641] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:04:35.933894 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:04:35.936079 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:04:35.959879 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] [instance: 0eea92e5-adbd-443e-83fe-9cb0f2875641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:04:35.963422 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:04:35.965309 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:04:36.037534 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:04:36.038390 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a781e114-b356-4495-bc7a-fb9874025ac1 tempest-ServersTestMultiNic-1084645041 tempest-ServersTestMultiNic-1084645041-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:05:26.887245 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:05:50.048905 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:05:51.089268 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 38824. Nov 25 15:06:04.845567 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:06:05.867932 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 39436. Nov 25 15:06:06.933108 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:06:07.006934 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:07.007418 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:07.119303 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:07.119714 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:07.122391 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:07.127895 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:07.159389 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Getting quotas for project e898d54a182c4026a1546bcbd19ddcce. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:06:07.164704 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Getting quotas for user 0db5770cc8424a28a5704bc545d66523 and project e898d54a182c4026a1546bcbd19ddcce. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:06:07.175925 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] [instance: 6cf117ce-9bf8-4b43-bd96-f55017186936] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:06:07.177803 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:07.178367 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:07.186750 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] [instance: 6cf117ce-9bf8-4b43-bd96-f55017186936] block_device_mapping [BlockDeviceMapping(attachment_id=f5639ba0-5025-4a41-a448-b276f6af60c9,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d8d457fd-bf8f-4264-8f36-9791ea2023a1',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=e0b866d0-ef6a-4115-ba2c-d7caee720d3a,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='20a5998d-4666-4d2b-933d-f97b62d00e7c',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=fd9942de-ee6a-4054-a8b6-80ef7664b499,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b523f79-a68b-4372-97c7-dea45b15f443',volume_size=1,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:06:07.189204 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:07.189849 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:07.201315 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:07.202095 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:07.211681 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:07.212439 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:07.288738 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:07.289579 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a549c7d0-2a67-4084-af97-1a41c8eb61b8 tempest-TaggedBootDevicesTest_v242-143222383 tempest-TaggedBootDevicesTest_v242-143222383-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:22.453113 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:06:22.491515 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:22.492108 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:22.552010 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:22.552725 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:22.553664 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:22.554484 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:22.593002 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Getting quotas for project 966c896c2d5241f8b0ecae2b30d0871f. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:06:22.601006 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Getting quotas for user 22554578e3b841f1873c1684f140c4a4 and project 966c896c2d5241f8b0ecae2b30d0871f. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:06:22.615240 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] [instance: 2f709d9a-edbb-4bbc-ae55-ebcd06e2e016] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:06:22.616626 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:22.617423 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:22.626984 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] [instance: 2f709d9a-edbb-4bbc-ae55-ebcd06e2e016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:06:22.629377 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:22.630104 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:22.692852 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:22.693495 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-dc66a837-ab3a-41ae-a0f1-a656382f38fa tempest-ServerTagsTestJSON-929925514 tempest-ServerTagsTestJSON-929925514-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:27.962304 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:06:27.986857 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:27.987284 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:28.048476 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:28.049164 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:28.050260 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:28.051042 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:28.070586 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:06:28.076129 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for user 45c5f44ade1348c09c73ee231723fc75 and project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:06:28.090181 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 705396f6-7c24-4fd2-9080-760c837b366e] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:06:28.091270 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:28.091940 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:28.101363 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 705396f6-7c24-4fd2-9080-760c837b366e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:06:28.104059 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:28.104480 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:28.160180 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:28.161029 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1d2f0340-1b9d-4db8-83f5-799858f42fc2 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:30.682807 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:06:30.730014 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:30.735432 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:30.814956 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:30.815552 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:30.817463 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:30.818109 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:30.839360 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Getting quotas for project f02418ce9c554a27b7fa232357f0012b. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:06:30.845309 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Getting quotas for user f8a4d883dea348b2b9420f184627a2a2 and project f02418ce9c554a27b7fa232357f0012b. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:06:30.862984 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] [instance: 40e5880e-7bb9-416a-a29b-955f3c47cd42] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:06:30.863968 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:30.864889 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:30.872771 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] [instance: 40e5880e-7bb9-416a-a29b-955f3c47cd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:06:30.874269 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:30.874673 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:06:30.923230 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:06:30.923907 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f459328-8c9e-4969-8d87-4618af56c83c tempest-InstanceActionsTestJSON-1305047225 tempest-InstanceActionsTestJSON-1305047225-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:02.366394 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:07:02.415819 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:02.416228 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:02.510574 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:02.511026 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:02.511752 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:02.512142 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:02.543601 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:07:02.548398 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for user 45c5f44ade1348c09c73ee231723fc75 and project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:07:02.577524 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: df1d34d5-b078-4434-bf3d-37ef500c44ab] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:07:02.578406 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:02.578809 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:02.604560 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: df1d34d5-b078-4434-bf3d-37ef500c44ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:07:02.607165 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:02.607165 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:02.660810 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:02.661253 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-aae566f6-94d9-414a-ada4-483484047430 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:23.222836 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:07:24.246887 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 40980. Nov 25 15:07:31.010094 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:07:31.101955 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.101955 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.250128 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.251869 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.253115 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.253853 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.284619 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Getting quotas for project c369d829ebcc45fa878834525723e619. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:07:31.293395 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Getting quotas for user 3112151bfa21417f91dd8fbf1deba3eb and project c369d829ebcc45fa878834525723e619. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:07:31.312496 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] [instance: 71cb8863-8971-4240-852c-7e251366cd10] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:07:31.314096 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.314916 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.325967 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] [instance: 71cb8863-8971-4240-852c-7e251366cd10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:07:31.328053 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.329571 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.376478 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.377399 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-712e2f55-58ea-4d71-a1a4-2a4a32df1692 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.463632 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Took 0.92 seconds to select destinations for 2 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:07:31.523348 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.524125 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.629760 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.630939 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.687568 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.689817 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.690678 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.691428 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.711268 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Getting quotas for project d8bee9fe41884c71b334ffd251f39671. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:07:31.716539 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Getting quotas for user dac8778fc9b14020bb805ab84fc64cfc and project d8bee9fe41884c71b334ffd251f39671. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:07:31.729370 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] [instance: 46b52c7e-0b66-4db4-8177-81c0c5b670fc] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:07:31.730470 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.731064 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.740407 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] [instance: 46b52c7e-0b66-4db4-8177-81c0c5b670fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:07:31.741923 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.742690 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.790160 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.790789 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.816947 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] [instance: aa2037ae-6758-402b-89f3-df25147cf052] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:07:31.817998 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.818410 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.840530 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] [instance: aa2037ae-6758-402b-89f3-df25147cf052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:07:31.842420 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.843254 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:31.915440 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:31.916030 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3b064ddc-eed6-460a-b73b-6b250edf8365 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:34.949200 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:07:34.980234 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:34.980652 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:35.047523 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:35.048135 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:35.049125 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:35.049676 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:35.067809 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Getting quotas for project c369d829ebcc45fa878834525723e619. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:07:35.086714 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Getting quotas for user 3112151bfa21417f91dd8fbf1deba3eb and project c369d829ebcc45fa878834525723e619. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:07:35.099567 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] [instance: 6a593b49-7cef-46a8-bace-9f64606be42f] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:07:35.100753 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:35.101380 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:35.110207 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] [instance: 6a593b49-7cef-46a8-bace-9f64606be42f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:07:35.112199 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:35.113023 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:35.194048 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:35.194474 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c098e388-4e49-407f-af5c-1d2319ade12c tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:35.689565 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:07:38.596236 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3e5dc8da-c401-421f-9539-6bd3f0d74e12 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method unshelve_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:07:38.596236 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3e5dc8da-c401-421f-9539-6bd3f0d74e12 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:38.596891 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3e5dc8da-c401-421f-9539-6bd3f0d74e12 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:39.292131 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3e5dc8da-c401-421f-9539-6bd3f0d74e12 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] [instance: 537b61e2-90d0-4eb8-9b1d-b1b9630906c5] Requesting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) during scheduling {{(pid=89840) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Nov 25 15:07:39.677352 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3e5dc8da-c401-421f-9539-6bd3f0d74e12 tempest-ServersNegativeTestJSON-488776507 tempest-ServersNegativeTestJSON-488776507-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:07:40.828271 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:07:40.858605 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:40.859252 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:40.936641 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:40.937224 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:40.939574 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:40.941141 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:40.966601 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:07:40.974712 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for user 45c5f44ade1348c09c73ee231723fc75 and project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:07:40.989272 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 8942c803-a138-4430-862d-a0e2dcc65f1c] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:07:40.990854 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:40.991375 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:41.005850 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 8942c803-a138-4430-862d-a0e2dcc65f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:07:41.008419 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:41.009394 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:41.113681 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:41.114388 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-57b2d12f-e777-4014-994d-ed8f090c346d tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:42.634017 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3ff2429f-ae67-48df-a879-5758229b8262 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method rebuild_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:07:42.634905 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3ff2429f-ae67-48df-a879-5758229b8262 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:07:42.636671 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-3ff2429f-ae67-48df-a879-5758229b8262 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:07:42.676365 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-3ff2429f-ae67-48df-a879-5758229b8262 tempest-ServerShowV247Test-1629967824 tempest-ServerShowV247Test-1629967824-project] [instance: 6a593b49-7cef-46a8-bace-9f64606be42f] No migration record for the rebuild/evacuate request. {{(pid=89840) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Nov 25 15:08:00.990394 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:08:01.024066 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:01.024541 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:01.099847 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:01.100743 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:01.101761 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:01.105095 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:01.132770 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Getting quotas for project 8e04d64ee44045f68b5b71d9a31eb442. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:08:01.140793 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Getting quotas for user 432081ffc4874a7b8d6266141ef04f1f and project 8e04d64ee44045f68b5b71d9a31eb442. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:08:01.159386 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] [instance: 37a5b03d-f741-448a-888f-544a66d7e47f] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:08:01.161320 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:01.161320 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:01.173913 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] [instance: 37a5b03d-f741-448a-888f-544a66d7e47f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:08:01.176943 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:01.177976 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:01.256365 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:01.256779 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51f1ad4b-e43a-43a2-9444-6f8b5fef55e7 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.485235 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Took 0.50 seconds to select destinations for 2 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:08:15.509716 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.510457 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.567327 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.568339 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.622248 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.622665 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.623517 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.626045 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.643326 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Getting quotas for project d8bee9fe41884c71b334ffd251f39671. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:08:15.648147 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Getting quotas for user dac8778fc9b14020bb805ab84fc64cfc and project d8bee9fe41884c71b334ffd251f39671. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:08:15.659516 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] [instance: e43a3530-a77d-49c5-a21c-14dd957dd043] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:08:15.660474 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.660887 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.669095 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] [instance: e43a3530-a77d-49c5-a21c-14dd957dd043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:08:15.670447 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.671404 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.705152 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.706090 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.718932 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] [instance: 496daf12-d8af-45cd-89ed-93d49865b857] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:08:15.720257 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.720831 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.746255 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] [instance: 496daf12-d8af-45cd-89ed-93d49865b857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:08:15.749518 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.750053 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:15.844995 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:15.845974 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f7500b8-d577-46ac-9a51-1bfbbff13f19 tempest-MultipleCreateTestJSON-1834294094 tempest-MultipleCreateTestJSON-1834294094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:32.546433 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:08:32.571062 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:32.571816 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:32.635871 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:32.636281 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:32.637005 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:32.637446 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:32.654835 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:08:32.659949 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for user 45c5f44ade1348c09c73ee231723fc75 and project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:08:32.672606 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 8bfc1820-9875-438d-9e9b-cf3ead94578b] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:08:32.673681 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:32.674186 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:32.682094 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 8bfc1820-9875-438d-9e9b-cf3ead94578b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:08:32.683609 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:32.684167 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:32.714970 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:32.715495 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e988bab4-e1be-4bf8-bac2-ef0737c9a137 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:37.318083 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:08:37.354124 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:37.354713 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:37.410467 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:37.410934 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:37.411675 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:37.412074 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:37.432763 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Getting quotas for project 8e04d64ee44045f68b5b71d9a31eb442. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:08:37.438227 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Getting quotas for user 432081ffc4874a7b8d6266141ef04f1f and project 8e04d64ee44045f68b5b71d9a31eb442. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:08:37.456700 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] [instance: e8cb09c2-2068-4e90-8b4d-464c5e1ab4d3] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:08:37.459258 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:37.459363 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:37.472272 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] [instance: e8cb09c2-2068-4e90-8b4d-464c5e1ab4d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:08:37.473608 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:37.474028 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:37.531359 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:37.531684 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-59df7f8e-d3e2-4a03-abed-1c0deaffd5f2 tempest-VolumesActionsTest-163782689 tempest-VolumesActionsTest-163782689-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:46.920985 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:08:50.142773 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:08:50.189381 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:50.189802 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:50.301464 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:50.301876 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:50.302633 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:50.303033 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:50.351808 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Getting quotas for project 8ad2053e8fd44df5b8b49736a27fa8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:08:50.357604 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Getting quotas for user a8b54eda03734343904c051015f83e4e and project 8ad2053e8fd44df5b8b49736a27fa8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:08:50.370588 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] [instance: 35238e58-8c44-455c-bff2-848e25d695ab] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:08:50.371943 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:50.372768 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:50.387177 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] [instance: 35238e58-8c44-455c-bff2-848e25d695ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:08:50.389622 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:50.390404 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:08:50.453691 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:08:50.454637 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c2eebc84-97ae-44a1-af43-ce46a42f9bb4 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:04.561160 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:09:04.590026 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:04.590773 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:04.658817 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:04.659224 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:04.660142 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:04.660541 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:04.688448 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Getting quotas for project fc9a90bf6d5d44bd8fe4ee6a1072e521. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:09:04.694951 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Getting quotas for user e4884db59d34479ab3ac0a37130be122 and project fc9a90bf6d5d44bd8fe4ee6a1072e521. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:09:04.712188 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] [instance: 0e948d8c-ed9d-4d93-b70c-921bf0e70ccd] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:09:04.713621 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:04.714034 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:04.736543 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] [instance: 0e948d8c-ed9d-4d93-b70c-921bf0e70ccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:09:04.737987 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:04.738590 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:04.788133 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:04.789513 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf48af7a-9ba4-4897-add8-a84c13089405 tempest-ServerMetadataNegativeTestJSON-1849620475 tempest-ServerMetadataNegativeTestJSON-1849620475-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:05.868095 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:09:06.890248 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 42730. Nov 25 15:09:07.455386 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:09:07.487567 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:07.488419 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:07.546139 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:07.547096 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:07.548109 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:07.548837 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:07.567177 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:09:07.572905 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for user 45c5f44ade1348c09c73ee231723fc75 and project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:09:07.584608 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 18b0a142-45f8-4eb0-a7bf-de77fc10dfd9] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:09:07.585934 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:07.586564 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:07.598524 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 18b0a142-45f8-4eb0-a7bf-de77fc10dfd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:09:07.601274 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:07.602406 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:07.650858 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:07.654322 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a329921a-b568-410d-beff-7d6bd68c9fba tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:30.323284 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:09:30.379541 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:30.379954 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:30.487991 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:30.488408 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:30.489283 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:30.489679 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:30.510543 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Getting quotas for project a702b2c92ffc4e719c9cd35dc0d4e723. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:09:30.515567 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Getting quotas for user b6d4d8cc345b4b4fb0ede196bc235e09 and project a702b2c92ffc4e719c9cd35dc0d4e723. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:09:30.526833 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] [instance: 8d90f740-b941-4824-954b-836d946447d8] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:09:30.527863 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:30.528433 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:30.544591 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] [instance: 8d90f740-b941-4824-954b-836d946447d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:09:30.546176 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:30.546937 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:30.608282 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:30.609377 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bf5ff607-35ad-405e-9deb-dc7aae30ca69 tempest-ServersNegativeTestMultiTenantJSON-1515819038 tempest-ServersNegativeTestMultiTenantJSON-1515819038-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:34.573806 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:09:34.654733 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:34.655190 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:34.798442 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:34.799102 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:34.800152 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:34.800700 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:34.821231 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Getting quotas for project 8ad2053e8fd44df5b8b49736a27fa8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:09:34.827505 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Getting quotas for user a8b54eda03734343904c051015f83e4e and project 8ad2053e8fd44df5b8b49736a27fa8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:09:34.841444 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] [instance: 017c4ea0-9a2c-4ba7-84ed-1d8a47555722] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:09:34.842801 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:34.843365 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:34.853494 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] [instance: 017c4ea0-9a2c-4ba7-84ed-1d8a47555722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:09:34.857531 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:34.858196 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:34.916579 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:34.918481 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-61fd6816-fc73-4674-b9d6-0de94dec965c tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:41.219007 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Took 1.10 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:09:41.278378 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:41.278786 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:41.379951 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:41.380740 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:41.386733 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:41.387452 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:41.430998 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:09:41.436284 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for user 45c5f44ade1348c09c73ee231723fc75 and project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:09:41.458648 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 723293a5-0ffc-43d6-83ad-4765eb12a5fc] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:09:41.459826 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:41.460383 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:41.481204 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 723293a5-0ffc-43d6-83ad-4765eb12a5fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:09:41.487590 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:41.488268 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:09:41.550813 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:09:41.551658 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c8f44eb5-bfc4-46a7-87e6-f56ee1cac4e6 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:11.993029 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:10:12.039540 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:12.042081 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:12.161457 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:12.162429 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:12.163504 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:12.166532 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:12.228320 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Getting quotas for project 8ad2053e8fd44df5b8b49736a27fa8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:10:12.237707 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Getting quotas for user a8b54eda03734343904c051015f83e4e and project 8ad2053e8fd44df5b8b49736a27fa8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:10:12.280292 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] [instance: 6077f1d2-08da-4cb5-9fc5-fb481ff7e7d8] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:10:12.287153 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:12.290479 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:12.325579 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] [instance: 6077f1d2-08da-4cb5-9fc5-fb481ff7e7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:10:12.329405 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:12.330018 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:12.388251 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:12.389043 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-00db7ff7-6a2b-45e7-8802-548074fb41a8 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:24.244022 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:10:24.437260 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:10:24.478156 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:24.479486 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:24.566499 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:24.567142 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:24.568367 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:24.568918 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:24.593118 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:10:24.598446 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for user 45c5f44ade1348c09c73ee231723fc75 and project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:10:24.610758 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 99bfa5e0-626c-464b-b295-4ace823905d5] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:10:24.612107 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:24.612702 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:24.622080 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: 99bfa5e0-626c-464b-b295-4ace823905d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:10:24.623857 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:24.624507 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:24.678691 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:24.679214 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-070279c0-f5be-483a-8fc6-95efbeb60442 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:25.266963 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 44770. Nov 25 15:10:49.481883 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:10:49.543818 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:49.544234 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:49.641850 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:49.642569 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:49.643864 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:49.645303 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:49.668368 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Getting quotas for project 8ad2053e8fd44df5b8b49736a27fa8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:10:49.682839 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Getting quotas for user a8b54eda03734343904c051015f83e4e and project 8ad2053e8fd44df5b8b49736a27fa8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:10:49.701673 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] [instance: 43ff3bed-1eec-4ae0-8a74-e7d748aabe2d] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:10:49.703407 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:49.703808 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:49.714569 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] [instance: 43ff3bed-1eec-4ae0-8a74-e7d748aabe2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:10:49.716613 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:49.717548 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:49.757844 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:49.758454 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8f00d2b6-dc52-4c22-a747-5b18f95f8e85 tempest-AttachVolumeNegativeTest-1589583494 tempest-AttachVolumeNegativeTest-1589583494-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:50.135817 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:10:50.180721 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:50.181452 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:50.315111 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:50.315718 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:50.316599 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:50.317253 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:50.349736 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:10:50.366255 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Getting quotas for user 45c5f44ade1348c09c73ee231723fc75 and project 63d838384a71478d9ea2f4a63c4073d7. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:10:50.393532 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: c27e25b2-bc04-4ce2-864b-b719a78be4ae] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:10:50.395853 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:50.397608 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:50.419849 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] [instance: c27e25b2-bc04-4ce2-864b-b719a78be4ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:10:50.421378 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:50.421913 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:50.495671 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:10:50.496248 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4e329adf-c13b-4914-9819-a47b8532cfc1 tempest-ServersTestJSON-1316454177 tempest-ServersTestJSON-1316454177-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:10:55.726962 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:12:06.889858 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:12:06.945031 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:12:07.630245 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:12:07.670109 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:07.670109 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:07.737877 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:07.738413 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:07.739310 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:07.739726 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:07.763943 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Getting quotas for project b5387e38a62f4c9cbc32448f718b6e9c. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:12:07.769931 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Getting quotas for user bef7f97f3c104b789443ef16b9b09641 and project b5387e38a62f4c9cbc32448f718b6e9c. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:12:07.783759 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] [instance: 262d152f-f2e6-42f6-9e80-63ad8ef104fd] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:12:07.785823 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:07.786396 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:07.794696 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] [instance: 262d152f-f2e6-42f6-9e80-63ad8ef104fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:12:07.796439 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:07.797035 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:07.834502 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:07.835216 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-edfcfe16-59f8-4407-b02a-8b07713ceef8 tempest-VolumesNegativeTest-1565682335 tempest-VolumesNegativeTest-1565682335-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:07.922110 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 48828. Nov 25 15:12:13.384522 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:12:13.414777 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:13.415197 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:13.492414 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:13.492991 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:13.494720 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:13.495280 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:13.516615 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Getting quotas for project 151c9e9b27c04cbf8b2e4689c95ff78f. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:12:13.523015 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Getting quotas for user ea5f58d79e5e4739a4294c846d25b086 and project 151c9e9b27c04cbf8b2e4689c95ff78f. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:12:13.547275 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] [instance: fa84f959-d37e-40e1-af67-558f1f4d401c] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:12:13.548456 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:13.549026 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:13.557873 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] [instance: fa84f959-d37e-40e1-af67-558f1f4d401c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:12:13.561465 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:13.562264 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:13.631098 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:13.631956 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-5ce66087-d4b1-47c4-b1f8-f86f1617f894 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:20.829555 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1a50420e-9cfc-4ef5-bc1e-1aaad8aef556 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method rebuild_instance {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:12:20.830122 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1a50420e-9cfc-4ef5-bc1e-1aaad8aef556 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:20.836877 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1a50420e-9cfc-4ef5-bc1e-1aaad8aef556 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:20.875320 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1a50420e-9cfc-4ef5-bc1e-1aaad8aef556 tempest-ServerShowV254Test-2015388282 tempest-ServerShowV254Test-2015388282-project] [instance: fa84f959-d37e-40e1-af67-558f1f4d401c] No migration record for the rebuild/evacuate request. {{(pid=89841) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Nov 25 15:12:31.084574 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:12:31.114186 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:31.114872 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:31.188430 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:31.189058 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:31.190223 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:31.191056 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:31.209171 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Getting quotas for project 3c23ba53657f46c799e3de4f45772172. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:12:31.213642 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Getting quotas for user b89225c9079b4aa39fc6d9c9decdc56d and project 3c23ba53657f46c799e3de4f45772172. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:12:31.224932 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] [instance: 5d9b603f-7960-4b12-b4b6-b412ae67e906] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:12:31.226166 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:31.226612 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:31.234733 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] [instance: 5d9b603f-7960-4b12-b4b6-b412ae67e906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:12:31.236040 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:31.236613 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:12:31.267185 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:12:31.267653 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b2ef50c1-9513-496e-b76d-f32fb432e8ac tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:21.950203 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:13:22.014210 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:22.014633 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:22.175886 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:22.178018 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:22.178852 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:22.179264 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:22.232429 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Getting quotas for project 6795ea74dc2e4822b9af2305c9df8961. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:13:22.242906 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Getting quotas for user 8a4cae8d633f4fd9af16c78f76f32f1a and project 6795ea74dc2e4822b9af2305c9df8961. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:13:22.277589 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] [instance: 3f6373a8-4768-470b-8b8c-c557375a873d] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:13:22.278557 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:22.278961 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:22.299956 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] [instance: 3f6373a8-4768-470b-8b8c-c557375a873d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:13:22.301705 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:22.302160 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:22.365920 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:22.366334 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-5250c3e0-103f-4586-8d45-5a7ac016a02b tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:25.266548 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:13:26.296952 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 51572. Nov 25 15:13:58.864638 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:13:58.922412 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:58.923101 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:59.004939 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:59.005815 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:59.007439 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:59.008073 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:59.043199 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Getting quotas for project 6d18541d1d5b4502974ed1c69a5dbf82. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:13:59.051379 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Getting quotas for user f86597724ebd4de182b9a9eda34e16a7 and project 6d18541d1d5b4502974ed1c69a5dbf82. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:13:59.066015 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] [instance: ba7721d2-a911-41db-bf2b-6775d6dd47ef] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:13:59.067337 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:59.067998 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:59.095376 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] [instance: ba7721d2-a911-41db-bf2b-6775d6dd47ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:13:59.098350 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:59.100759 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:13:59.184984 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:13:59.187292 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7bc94e08-5f31-4665-a304-783f3c76604f tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:10.910904 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:14:10.961994 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:10.964840 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:11.059725 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:11.060150 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:11.061109 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:11.061665 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:11.098253 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Getting quotas for project 3c23ba53657f46c799e3de4f45772172. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:14:11.108558 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Getting quotas for user b89225c9079b4aa39fc6d9c9decdc56d and project 3c23ba53657f46c799e3de4f45772172. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:14:11.134491 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] [instance: 88bd6572-1fa9-4d8a-be5a-d7cc3c8a2a49] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:14:11.135450 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:11.135846 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:11.166890 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] [instance: 88bd6572-1fa9-4d8a-be5a-d7cc3c8a2a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:14:11.168260 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:11.168680 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:11.247446 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:11.247864 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e5b0c11b-afec-404f-935b-d4c6b493bdba tempest-VolumesSnapshotTestJSON-16128873 tempest-VolumesSnapshotTestJSON-16128873-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:15.750555 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:14:26.929095 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:14:26.958834 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:26.959583 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:27.069141 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:27.073400 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:27.076316 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:27.077934 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:27.118535 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Getting quotas for project 2c90ac4c8efa44d4876294895d856efc. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:14:27.132964 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Getting quotas for user 6b14024a03df4b7cbb5ed6ae0c64fec6 and project 2c90ac4c8efa44d4876294895d856efc. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:14:27.163527 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] [instance: f0504649-0729-45e7-90da-a27354ee6f67] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:14:27.166327 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:27.167611 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:27.191297 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] [instance: f0504649-0729-45e7-90da-a27354ee6f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:14:27.192646 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:27.193089 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:27.258558 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:27.259804 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-546b3bfd-15c0-4398-b584-74b917f0cc97 tempest-VolumesActionsTest-959230015 tempest-VolumesActionsTest-959230015-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:35.065820 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-388705be-c3ed-4413-adbf-6147b7bb2b85 tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:14:35.069754 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-388705be-c3ed-4413-adbf-6147b7bb2b85 tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:35.072933 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-388705be-c3ed-4413-adbf-6147b7bb2b85 tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:36.218086 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-388705be-c3ed-4413-adbf-6147b7bb2b85 tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] [instance: 3f6373a8-4768-470b-8b8c-c557375a873d] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89841) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 15:14:36.824894 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-388705be-c3ed-4413-adbf-6147b7bb2b85 tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Created allocations for migration ab1c7f74-ae49-40a0-92fa-ffabfe04f6dc on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 15:14:37.198638 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-388705be-c3ed-4413-adbf-6147b7bb2b85 tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] [instance: 3f6373a8-4768-470b-8b8c-c557375a873d] Calling prep_resize with selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89841) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 15:14:54.058914 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Took 1.22 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:14:54.123386 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:54.123808 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:54.287840 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:54.294467 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:54.295554 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:54.296122 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:54.346795 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Getting quotas for project c15c2e4497724c0f8c1ea14efb6edde1. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:14:54.357836 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Getting quotas for user 1b028a36482d4da2876da3570fa6dfb2 and project c15c2e4497724c0f8c1ea14efb6edde1. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:14:54.373695 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] [instance: 94240ecb-2b06-41b2-a226-2ec30dca8ea6] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:14:54.374931 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:54.375507 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:54.392302 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] [instance: 94240ecb-2b06-41b2-a226-2ec30dca8ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:14:54.393920 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:54.394544 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:54.472405 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:54.473140 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ade7c7a0-3352-4182-81a7-5e2c87a5becb tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:56.848294 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:14:56.927787 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:56.929995 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:57.041438 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:57.043357 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:57.048126 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:57.048126 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:57.089700 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Getting quotas for project c15c2e4497724c0f8c1ea14efb6edde1. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:14:57.101582 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Getting quotas for user 1b028a36482d4da2876da3570fa6dfb2 and project c15c2e4497724c0f8c1ea14efb6edde1. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:14:57.128902 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] [instance: a5b89ded-03d8-4dda-9a0e-9bb939e0f95e] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:14:57.130008 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:57.130424 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:57.150857 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] [instance: a5b89ded-03d8-4dda-9a0e-9bb939e0f95e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:14:57.153538 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:57.154013 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:57.224510 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:57.224971 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-964b48b7-cbc1-4d3b-9a45-341dcfa8aae6 tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:59.909449 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:14:59.935690 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:59.936359 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:59.987115 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:59.987590 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:14:59.988454 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:14:59.988850 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:15:00.006664 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Getting quotas for project c15c2e4497724c0f8c1ea14efb6edde1. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:15:00.012904 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Getting quotas for user 1b028a36482d4da2876da3570fa6dfb2 and project c15c2e4497724c0f8c1ea14efb6edde1. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:15:00.024064 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] [instance: 490a5744-9c55-4419-8503-2c1e8071a4fc] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:15:00.025010 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:15:00.025450 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:15:00.034334 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] [instance: 490a5744-9c55-4419-8503-2c1e8071a4fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:15:00.036181 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:15:00.036656 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:15:00.085346 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:15:00.086053 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-6979989c-bb86-4b83-9a16-63b6d720309f tempest-ListServerFiltersTestJSON-1077680241 tempest-ListServerFiltersTestJSON-1077680241-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:15:07.919961 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:15:08.942937 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53516. Nov 25 15:15:26.970193 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:16:26.285110 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:16:27.307091 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 54930. Nov 25 15:16:57.076653 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Took 0.71 seconds to select destinations for 3 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:16:57.119475 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.119873 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.204796 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.205672 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.294402 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.296731 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.355203 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.356967 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.357961 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.358877 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.379926 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Getting quotas for project 2b6c12332007476fb37fdf96f2c4ec48. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:16:57.393118 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Getting quotas for user 865de340d14f4ce9aec026ef26e78eeb and project 2b6c12332007476fb37fdf96f2c4ec48. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:16:57.412807 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] [instance: 7d223eaa-3f3b-490d-95ce-9304de2542cf] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:16:57.413995 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.414410 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.425867 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] [instance: 7d223eaa-3f3b-490d-95ce-9304de2542cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:16:57.427363 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.428611 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.469962 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.470641 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.488389 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] [instance: dd53ec2d-9535-49c7-acce-aed7774c1852] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:16:57.489661 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.492979 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.506129 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] [instance: dd53ec2d-9535-49c7-acce-aed7774c1852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:16:57.508407 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.510413 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.556434 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.557463 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.576114 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] [instance: df2d2f3e-f2fe-4787-8bf2-29f60982d85f] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:16:57.578945 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.579628 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.596708 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] [instance: df2d2f3e-f2fe-4787-8bf2-29f60982d85f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:16:57.598891 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.599452 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:16:57.656501 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:16:57.657095 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2e374716-c683-4b23-87b8-b3e470201342 tempest-ListServersNegativeTestJSON-31821497 tempest-ListServersNegativeTestJSON-31821497-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:32.120333 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:17:32.166518 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:32.166928 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:32.239146 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:32.240187 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:32.241238 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:32.241871 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:32.259988 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Getting quotas for project 6795ea74dc2e4822b9af2305c9df8961. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:17:32.265176 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Getting quotas for user 8a4cae8d633f4fd9af16c78f76f32f1a and project 6795ea74dc2e4822b9af2305c9df8961. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:17:32.276848 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] [instance: 2f5b1734-d8cd-4f01-91ea-334f00924944] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:17:32.279248 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:32.279899 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:32.289840 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] [instance: 2f5b1734-d8cd-4f01-91ea-334f00924944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:17:32.291655 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:32.292394 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:32.330144 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:32.331012 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-530fe147-e240-4205-9c33-8b9bd4a644f3 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:35.787831 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:17:44.802058 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:17:44.834954 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:44.835420 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:44.944688 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:44.945720 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:44.946481 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:44.950593 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:45.000412 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Getting quotas for project a0c4bc138319492e860c27df7ce8dbee. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:17:45.013487 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Getting quotas for user fe3b50a980f54134b2c8d9bcd807980d and project a0c4bc138319492e860c27df7ce8dbee. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:17:45.046860 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] [instance: f5f6c0d0-15d7-44d6-a8f0-c61d53c00bf8] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:17:45.048035 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:45.048794 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:45.057892 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] [instance: f5f6c0d0-15d7-44d6-a8f0-c61d53c00bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:17:45.059932 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:45.060593 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:17:45.106366 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:17:45.107162 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-04bd6b2c-ed0f-41f4-8b7b-089473d0f551 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:08.440716 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-405f2671-f730-4a1c-ae3e-c415fdadcd72 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method rebuild_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:18:08.441360 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-405f2671-f730-4a1c-ae3e-c415fdadcd72 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:08.441772 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-405f2671-f730-4a1c-ae3e-c415fdadcd72 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:08.461392 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-405f2671-f730-4a1c-ae3e-c415fdadcd72 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] [instance: f5f6c0d0-15d7-44d6-a8f0-c61d53c00bf8] No migration record for the rebuild/evacuate request. {{(pid=89840) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Nov 25 15:18:08.944422 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:18:09.970845 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56770. Nov 25 15:18:16.186764 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:18:16.211227 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:16.211997 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:16.308402 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:16.309708 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:16.310632 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:16.311441 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:16.336967 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Getting quotas for project cba0198055194d0682db4c582eb20f94. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:18:16.342916 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Getting quotas for user db1d39425a484ab186b255920eeabfe2 and project cba0198055194d0682db4c582eb20f94. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:18:16.356563 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] [instance: e3303fcd-e11f-4499-bf4c-931695543fae] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:18:16.357814 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:16.358382 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:16.376305 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] [instance: e3303fcd-e11f-4499-bf4c-931695543fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:18:16.378532 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:16.379495 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:16.460254 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:16.460689 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-1cabb057-f3fb-46f9-b2fe-e9b98eb94002 tempest-TestServerBasicOps-447729694 tempest-TestServerBasicOps-447729694-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:17.838644 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:18:17.871312 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:17.872247 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:17.982297 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:17.982792 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:17.983433 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:17.983827 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:18.014188 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Getting quotas for project de739482871d454db50b2d88cf9652d6. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:18:18.022135 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Getting quotas for user 88c792524a574537be8549d15ec59a43 and project de739482871d454db50b2d88cf9652d6. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:18:18.040157 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] [instance: cf9b1a96-88e5-4bcf-acb1-18ef3343ae00] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:18:18.041125 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:18.041540 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:18.063209 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] [instance: cf9b1a96-88e5-4bcf-acb1-18ef3343ae00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:18:18.067096 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:18.067515 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:18.151840 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:18.152113 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-19411a79-264f-4ed9-b7cf-4f3a73eafab8 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:47.019966 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:18:50.502376 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:18:50.527531 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:50.528329 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:50.585747 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:50.586878 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:50.587856 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:50.588477 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:50.609450 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Getting quotas for project a0c4bc138319492e860c27df7ce8dbee. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:18:50.615877 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Getting quotas for user fe3b50a980f54134b2c8d9bcd807980d and project a0c4bc138319492e860c27df7ce8dbee. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:18:50.628845 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] [instance: baef72e2-256d-4d84-84de-42b9f4c1dbd6] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:18:50.630233 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:50.630944 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:50.639423 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] [instance: baef72e2-256d-4d84-84de-42b9f4c1dbd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:18:50.641239 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:50.642049 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:18:50.681425 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:18:50.682276 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-72a9fff7-0cff-4859-be6b-70d950ded676 tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:09.734528 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c5f5e24c-c573-4fed-ac77-6d380284778d tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method rebuild_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:19:09.736038 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c5f5e24c-c573-4fed-ac77-6d380284778d tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:09.736662 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c5f5e24c-c573-4fed-ac77-6d380284778d tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:09.789482 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c5f5e24c-c573-4fed-ac77-6d380284778d tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] [instance: baef72e2-256d-4d84-84de-42b9f4c1dbd6] No migration record for the rebuild/evacuate request. {{(pid=89840) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Nov 25 15:19:18.480786 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:19:18.520683 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:18.521125 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:18.572790 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:18.573241 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:18.573973 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:18.574365 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:18.595644 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Getting quotas for project de739482871d454db50b2d88cf9652d6. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:19:18.601966 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Getting quotas for user 88c792524a574537be8549d15ec59a43 and project de739482871d454db50b2d88cf9652d6. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:19:18.617009 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] [instance: 4a6c1402-4a01-481c-9a22-668b9911126c] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:19:18.618055 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:18.618460 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:18.628740 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] [instance: 4a6c1402-4a01-481c-9a22-668b9911126c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:19:18.631388 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:18.631987 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:18.705334 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:18.706542 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-09def739-008e-4df9-8f04-4d18d4804295 tempest-ServerRescueTestJSON-2108871318 tempest-ServerRescueTestJSON-2108871318-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:21.791519 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8e56cbbc-d33a-4da0-85d6-a0b5a662d26c tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:19:21.792141 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8e56cbbc-d33a-4da0-85d6-a0b5a662d26c tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:21.792392 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8e56cbbc-d33a-4da0-85d6-a0b5a662d26c tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:22.602721 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-8e56cbbc-d33a-4da0-85d6-a0b5a662d26c tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] [instance: 2f5b1734-d8cd-4f01-91ea-334f00924944] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89840) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 15:19:23.030724 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-8e56cbbc-d33a-4da0-85d6-a0b5a662d26c tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Created allocations for migration 0e4f51af-5629-4838-8a1e-2f60c0dc760a on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 15:19:23.314487 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-8e56cbbc-d33a-4da0-85d6-a0b5a662d26c tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] [instance: 2f5b1734-d8cd-4f01-91ea-334f00924944] Calling prep_resize with selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89840) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 15:19:27.306126 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:19:28.323593 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 58136. Nov 25 15:19:55.435628 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:19:55.458645 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:55.459066 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:55.507781 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:55.508046 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:55.508843 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:55.509289 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:55.527557 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Getting quotas for project a0c4bc138319492e860c27df7ce8dbee. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:19:55.536229 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Getting quotas for user fe3b50a980f54134b2c8d9bcd807980d and project a0c4bc138319492e860c27df7ce8dbee. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:19:55.551777 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] [instance: eed0dfa7-4ac0-416d-89e9-6750ad215dc9] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:19:55.552740 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:55.553257 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:55.562935 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] [instance: eed0dfa7-4ac0-416d-89e9-6750ad215dc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:19:55.565277 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:55.566541 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:19:55.611864 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:19:55.612415 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-4e9b81d1-ca41-4821-98bc-df8b5200999a tempest-ServerDiskConfigTestJSON-1518243022 tempest-ServerDiskConfigTestJSON-1518243022-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:23.401631 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:20:23.446190 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:23.449238 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:23.571455 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:23.571867 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:23.573026 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:23.573471 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:23.599431 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Getting quotas for project 582f3077ce7d42c98fa97ca33e938c95. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:20:23.605153 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Getting quotas for user c9170285b71e4503905e469ed2847760 and project 582f3077ce7d42c98fa97ca33e938c95. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:20:23.618375 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] [instance: 0c9d301c-d045-4034-b6e9-8796bfffb930] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:20:23.619383 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:23.619793 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:23.640177 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] [instance: 0c9d301c-d045-4034-b6e9-8796bfffb930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:20:23.643081 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:23.644550 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:23.709455 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:23.710530 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-b329c0fd-c40f-429c-a158-6b4b466af486 tempest-InstanceActionsV221TestJSON-564310582 tempest-InstanceActionsV221TestJSON-564310582-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:31.932480 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:20:31.961566 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:31.962080 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:32.020645 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:32.021054 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:32.022022 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:32.022590 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:32.046927 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Getting quotas for project 6d18541d1d5b4502974ed1c69a5dbf82. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:20:32.052078 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Getting quotas for user f86597724ebd4de182b9a9eda34e16a7 and project 6d18541d1d5b4502974ed1c69a5dbf82. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:20:32.083394 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] [instance: 01c3f8cd-9bc4-487d-b524-f607a310be2c] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:20:32.084729 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:32.086555 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:32.143105 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] [instance: 01c3f8cd-9bc4-487d-b524-f607a310be2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:20:32.144769 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:32.145443 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:20:32.194992 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:20:32.195579 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-93a8c412-0e66-4fde-b8e4-cc232fec8919 tempest-AttachVolumeTestJSON-1183906452 tempest-AttachVolumeTestJSON-1183906452-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:09.970763 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:21:10.152684 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:21:10.230998 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:10.231408 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:10.450547 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:10.450941 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:10.451663 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:10.452048 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:10.532788 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:21:10.546138 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for user 6773cb0e5ef74e37a7a826ccd98d397a and project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:21:10.578265 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: 01b99051-60a0-46eb-8520-79ca5f2a71a3] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:21:10.579232 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:10.579633 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:10.614210 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: 01b99051-60a0-46eb-8520-79ca5f2a71a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:21:10.615641 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:10.616157 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:10.688232 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:10.688912 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a8876c71-a041-4a3c-a96c-817a160552a0 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:10.999065 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60924. Nov 25 15:21:46.183979 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:21:46.208927 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:46.209434 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:46.266454 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:46.266858 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:46.267920 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:46.268519 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:46.287116 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Getting quotas for project 6795ea74dc2e4822b9af2305c9df8961. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:21:46.292654 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Getting quotas for user 8a4cae8d633f4fd9af16c78f76f32f1a and project 6795ea74dc2e4822b9af2305c9df8961. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:21:46.304551 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] [instance: 7f2a17ff-ccfe-40ae-b219-106ba36b32d5] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:21:46.306314 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:46.306758 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:46.330608 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] [instance: 7f2a17ff-ccfe-40ae-b219-106ba36b32d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:21:46.330608 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:46.330608 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:21:46.378305 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:21:46.378305 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-7f56673e-af2f-4c85-a280-038d990eb748 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:22:07.048889 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:22:26.111049 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:22:26.150277 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:22:26.150747 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:22:26.207171 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:22:26.207709 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:22:26.208903 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:22:26.209556 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:22:26.228132 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Getting quotas for project 7acb45f7145042fd86312554674589d8. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:22:26.233163 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Getting quotas for user d9243c8c53134c51b0a2a5cba54f7bf5 and project 7acb45f7145042fd86312554674589d8. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:22:26.246889 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] [instance: e87eb63c-506c-4b5c-8da8-175a5fc895e4] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:22:26.248108 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:22:26.248471 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:22:26.256200 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] [instance: e87eb63c-506c-4b5c-8da8-175a5fc895e4] block_device_mapping [BlockDeviceMapping(attachment_id=87560e13-fa2f-4526-b76c-1c597e396f39,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13fb1619-a9f5-4e1b-8ea2-a51de0279503',volume_size=1,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:22:26.258473 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:22:26.258890 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:22:26.299070 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:22:26.299519 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8f534f47-c333-4e8b-9ea4-a2db8d71ddc9 tempest-TestVolumeBackupRestore-946168947 tempest-TestVolumeBackupRestore-946168947-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:22:28.325539 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:22:29.353867 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 35280. Nov 25 15:23:20.282922 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:23:20.319063 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:23:20.319063 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:23:20.422240 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:23:20.422370 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:23:20.425631 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:23:20.426304 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:23:20.477524 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Getting quotas for project 4478ce8642ad4dd7ba659c0bcb13ae33. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:23:20.483572 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Getting quotas for user b683e3526faf4a91ad02f40dbc3a7d2e and project 4478ce8642ad4dd7ba659c0bcb13ae33. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:23:20.514379 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] [instance: ca24f7eb-6ab6-4af3-92fd-25efb2284c94] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:23:20.521886 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:23:20.522168 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:23:20.538572 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] [instance: ca24f7eb-6ab6-4af3-92fd-25efb2284c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:23:20.539243 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:23:20.539736 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:23:20.608332 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:23:20.608867 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-357c3975-c0a1-470d-b591-3053fec4d536 tempest-VolumesBackupsTest-975042242 tempest-VolumesBackupsTest-975042242-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:23:28.713190 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-91dd2407-3c96-4b6d-8f5b-173017a55ade tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:23:28.713823 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-91dd2407-3c96-4b6d-8f5b-173017a55ade tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:23:28.714326 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-91dd2407-3c96-4b6d-8f5b-173017a55ade tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:23:29.440797 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-91dd2407-3c96-4b6d-8f5b-173017a55ade tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Created allocations for migration b1b43ec5-0c9c-43fd-b297-27ab056ea482 on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 15:23:29.817035 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.live_migrate [None req-91dd2407-3c96-4b6d-8f5b-173017a55ade tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] [instance: 7f2a17ff-ccfe-40ae-b219-106ba36b32d5] Requesting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while live migrating {{(pid=89840) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:495}} Nov 25 15:23:30.287414 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-91dd2407-3c96-4b6d-8f5b-173017a55ade tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Lazy-loading 'resources' on Instance uuid 7f2a17ff-ccfe-40ae-b219-106ba36b32d5 {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 15:23:30.298310 n-d-819181-1 nova-conductor[89840]: DEBUG nova.objects.instance [None req-91dd2407-3c96-4b6d-8f5b-173017a55ade tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] Lazy-loading 'pci_requests' on Instance uuid 7f2a17ff-ccfe-40ae-b219-106ba36b32d5 {{(pid=89840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 25 15:23:30.905385 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.live_migrate [None req-91dd2407-3c96-4b6d-8f5b-173017a55ade tempest-TestNetworkAdvancedServerOps-685309169 tempest-TestNetworkAdvancedServerOps-685309169-project-admin] [instance: 7f2a17ff-ccfe-40ae-b219-106ba36b32d5] Start binding ports on destination host: n-h1-819181-1 {{(pid=89840) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Nov 25 15:24:15.821866 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:25:13.512010 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Took 1.21 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:25:13.562582 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:13.562995 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:13.690885 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:13.691305 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:13.693266 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:13.694255 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:13.735659 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Getting quotas for project 6795ea74dc2e4822b9af2305c9df8961. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:25:13.746084 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Getting quotas for user 8a4cae8d633f4fd9af16c78f76f32f1a and project 6795ea74dc2e4822b9af2305c9df8961. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:25:13.790842 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] [instance: 923bdce1-3768-41b6-8a9a-f0093ec407a7] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:25:13.791880 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:13.792292 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:13.823028 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] [instance: 923bdce1-3768-41b6-8a9a-f0093ec407a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:25:13.825251 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:13.825910 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:13.898422 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:13.899101 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-ed796c8e-2799-4e54-ac48-9162d17a5623 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:14.646709 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:25:14.688119 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:14.688707 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:14.760760 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:14.761356 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:14.762485 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:14.764005 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:14.798862 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:25:14.804319 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for user 6773cb0e5ef74e37a7a826ccd98d397a and project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:25:14.817756 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: 505d9538-7506-4b00-a5f7-80eb9b514739] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:25:14.819500 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:14.820099 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:14.830516 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: 505d9538-7506-4b00-a5f7-80eb9b514739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:25:14.832348 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:14.833024 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:14.899664 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:25:14.900252 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9ceb8c4d-756b-4995-9d06-bdbc01267e0e tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:25:27.108757 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:25:29.353962 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:25:30.373758 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 39974. Nov 25 15:26:10.999953 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:26:12.027114 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 40702. Nov 25 15:26:12.871963 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:26:12.901718 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:26:12.902118 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:26:12.952067 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:26:12.952351 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:26:12.953143 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:26:12.953511 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:26:12.971617 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:26:12.981192 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for user 6773cb0e5ef74e37a7a826ccd98d397a and project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:26:12.992683 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: ab82925d-fb04-4e7c-9eb9-991fc0adb989] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:26:12.994235 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:26:12.994888 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:26:13.024711 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: ab82925d-fb04-4e7c-9eb9-991fc0adb989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:26:13.028863 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:26:13.029453 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:26:13.084120 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:26:13.085379 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-de23500c-c22c-4bf7-8729-6c1cc9468c21 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:26:55.638384 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-747a6b3a-25e1-4a57-95d7-a68428308135 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method rebuild_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:26:55.639603 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-747a6b3a-25e1-4a57-95d7-a68428308135 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:26:55.640575 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-747a6b3a-25e1-4a57-95d7-a68428308135 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:26:55.666063 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-747a6b3a-25e1-4a57-95d7-a68428308135 tempest-TestNetworkAdvancedServerOps-1636128291 tempest-TestNetworkAdvancedServerOps-1636128291-project] [instance: 923bdce1-3768-41b6-8a9a-f0093ec407a7] No migration record for the rebuild/evacuate request. {{(pid=89840) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Nov 25 15:27:36.937917 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:27:37.961234 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 42668. Nov 25 15:28:22.840395 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:28:22.865719 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:22.866196 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:22.926529 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:22.927180 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:22.927991 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:22.928568 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:22.952998 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:28:22.959097 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for user 6773cb0e5ef74e37a7a826ccd98d397a and project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:28:22.970782 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: c2fd57df-66a1-4b4d-884a-3bd4c056becf] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:28:22.971886 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:22.972388 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:22.981611 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: c2fd57df-66a1-4b4d-884a-3bd4c056becf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:28:22.983096 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:22.983669 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:23.047548 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:23.061958 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-88f13afb-ccf7-402d-9f55-eae3e0a662b7 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:30.374101 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:28:31.405032 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 44334. Nov 25 15:28:47.147739 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:28:52.391844 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:28:52.452760 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:52.453208 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:52.506017 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:52.506663 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:52.517093 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:52.517585 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:52.550784 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:28:52.566304 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Getting quotas for user 6773cb0e5ef74e37a7a826ccd98d397a and project cdfa1a3d43d64219a3a591a0d0e6028a. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:28:52.569500 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: ebcf4a90-3d40-4956-bcfd-b4575ccbb646] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:28:52.569500 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:52.569500 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:52.585826 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] [instance: ebcf4a90-3d40-4956-bcfd-b4575ccbb646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:28:52.587823 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:52.589762 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:52.686580 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:52.686580 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab8f8b82-3ce5-486d-bc22-1c1973c5d737 tempest-ServerActionsTestJSON-1560704680 tempest-ServerActionsTestJSON-1560704680-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:58.846495 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:28:58.898448 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:58.898448 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:59.038206 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:59.039683 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:59.040439 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:59.040923 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:59.127928 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Getting quotas for project 9ecc75c1deef496eae3e04ba2b12e40e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:28:59.141058 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Getting quotas for user 82073a4c81ff451d9d795a52f1542847 and project 9ecc75c1deef496eae3e04ba2b12e40e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:28:59.169984 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] [instance: 899a1bd5-bfa3-43e5-85b4-4881bce4dfdf] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:28:59.169984 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:59.171955 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:59.205356 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] [instance: 899a1bd5-bfa3-43e5-85b4-4881bce4dfdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:28:59.205356 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:59.205356 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:28:59.301270 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:28:59.301270 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-51e9f12f-f678-4beb-9cfd-da55a0ca1cd5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:29:12.026070 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:29:13.060929 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 45170. Nov 25 15:29:15.867034 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:29:17.216758 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:29:17.245671 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:29:17.245671 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:29:17.311328 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:29:17.312069 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:29:17.312933 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:29:17.313451 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:29:17.353918 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Getting quotas for project be205c5794dd4b1a8d185fdc0a9d36c4. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:29:17.360722 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Getting quotas for user 04218c05d234499c9c8a1e426a95997b and project be205c5794dd4b1a8d185fdc0a9d36c4. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:29:17.379522 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] [instance: 1472ecf6-eccb-4649-b124-ccd12675e78f] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:29:17.379522 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:29:17.379522 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:29:17.399449 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] [instance: 1472ecf6-eccb-4649-b124-ccd12675e78f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:29:17.399449 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:29:17.399449 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:29:17.446916 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:29:17.446916 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bc9316f7-9827-4951-b05f-419948757acf tempest-TestServerAdvancedOps-2043054634 tempest-TestServerAdvancedOps-2043054634-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:07.228407 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:30:07.276635 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:07.277051 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:07.362947 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:07.363358 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:07.364086 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:07.367530 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:07.406358 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Getting quotas for project 9ecc75c1deef496eae3e04ba2b12e40e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:30:07.412553 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Getting quotas for user 82073a4c81ff451d9d795a52f1542847 and project 9ecc75c1deef496eae3e04ba2b12e40e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:30:07.433906 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] [instance: 3e037336-e820-481d-b204-667e419a8e39] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:30:07.438997 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:07.439554 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:07.453199 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] [instance: 3e037336-e820-481d-b204-667e419a8e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:30:07.454630 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:07.455157 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:07.506598 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:07.507211 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-34b08d05-1411-4669-9632-e5e5682f57b5 tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:20.171849 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:30:20.212786 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:20.213955 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:20.319887 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:20.320857 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:20.323317 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:20.325207 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:20.367757 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Getting quotas for project 9b1c749302d249239f5c1258e07c9c95. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:30:20.376972 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Getting quotas for user e69cd4d25efe4a82b84c2b53a6dfa366 and project 9b1c749302d249239f5c1258e07c9c95. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:30:20.390940 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] [instance: 5dec95c8-8cbc-4022-8c6e-0e8572c9e449] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:30:20.391891 n-d-819181-1 nova-conductor[89840]: DEBUG nova.scheduler.utils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-819181-1']) and/or node ([]) {{(pid=89840) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Nov 25 15:30:20.392862 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:20.393448 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:20.405805 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] [instance: 5dec95c8-8cbc-4022-8c6e-0e8572c9e449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:30:20.407965 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:20.409541 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:20.516273 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:20.517003 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7a7f27a5-86a0-4d32-ade6-f3b71b70c784 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:33.340317 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:30:33.376692 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:33.377392 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:33.554066 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:33.556296 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:33.557897 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:33.564953 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:33.625703 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Getting quotas for project 9b1c749302d249239f5c1258e07c9c95. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:30:33.645323 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Getting quotas for user e69cd4d25efe4a82b84c2b53a6dfa366 and project 9b1c749302d249239f5c1258e07c9c95. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:30:33.672632 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] [instance: 1a61d22a-8cb2-41ac-9cd6-f4e30ff2b73b] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:30:33.673601 n-d-819181-1 nova-conductor[89841]: DEBUG nova.scheduler.utils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-819181-1']) and/or node ([]) {{(pid=89841) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Nov 25 15:30:33.674613 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:33.676396 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:33.698974 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] [instance: 1a61d22a-8cb2-41ac-9cd6-f4e30ff2b73b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:30:33.701656 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:33.702371 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:33.782934 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:33.783905 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-29b2c035-6029-44b9-a1a7-89f02c3bc679 tempest-TestServerMultinode-163985150 tempest-TestServerMultinode-163985150-project-admin] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:51.207984 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:30:51.240695 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:51.241446 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:51.312342 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:51.313528 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:51.314733 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:51.315266 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:51.336865 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Getting quotas for project 9891181485664e0ab7e217e3e7388d1b. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:30:51.343216 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Getting quotas for user bdc2b4a28b874530ba7a362522065966 and project 9891181485664e0ab7e217e3e7388d1b. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:30:51.354282 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] [instance: 7a0cb10a-9d5f-426a-ac2f-f4fe652101fb] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:30:51.355263 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:51.356156 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:51.362513 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] [instance: 7a0cb10a-9d5f-426a-ac2f-f4fe652101fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:30:51.363899 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:51.364340 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:30:51.390939 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:30:51.391294 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-68975375-a50e-434b-aee0-f42587b4c639 tempest-ServerPasswordTestJSON-1415693513 tempest-ServerPasswordTestJSON-1415693513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:23.002925 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:31:23.030825 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:23.031269 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:23.101630 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:23.102038 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:23.102824 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:23.103226 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:23.125720 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Getting quotas for project 836a95df5b454809a26129d10e820f39. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:31:23.132896 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Getting quotas for user e2ec551c08d7404982416e81624054ea and project 836a95df5b454809a26129d10e820f39. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:31:23.146476 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] [instance: 10dd70dd-1e84-4fce-991d-a7a790df307b] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:31:23.148297 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:23.148743 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:23.157010 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] [instance: 10dd70dd-1e84-4fce-991d-a7a790df307b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:31:23.158304 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:23.158712 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:23.197923 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:23.197923 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-b9441a8e-3eb5-4dbf-9cbb-0478b353a188 tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:24.564976 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:31:24.595313 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:24.595720 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:24.685947 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:24.686760 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:24.687824 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:24.688378 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:24.706303 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Getting quotas for project 836a95df5b454809a26129d10e820f39. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:31:24.711387 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Getting quotas for user e2ec551c08d7404982416e81624054ea and project 836a95df5b454809a26129d10e820f39. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:31:24.723592 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] [instance: 66c1be5a-1b66-40a1-b7c2-bf1497eb044d] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:31:24.724769 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:24.725361 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:24.735756 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] [instance: 66c1be5a-1b66-40a1-b7c2-bf1497eb044d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:31:24.737453 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:24.738089 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:24.784628 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:24.785651 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-4bd82dd1-a72e-4de7-9a5a-5114636d6bbe tempest-ServerRescueNegativeTestJSON-1986797123 tempest-ServerRescueNegativeTestJSON-1986797123-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:31.402825 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:31:32.427374 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 48444. Nov 25 15:31:47.471155 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:31:47.492993 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:47.493435 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:47.541869 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:47.542810 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:47.543930 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:47.544330 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:47.560483 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Getting quotas for project 9ecc75c1deef496eae3e04ba2b12e40e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:31:47.565341 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Getting quotas for user 82073a4c81ff451d9d795a52f1542847 and project 9ecc75c1deef496eae3e04ba2b12e40e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:31:47.576746 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] [instance: 707b8265-c1ce-4e8f-9fd2-df6140813b80] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:31:47.577797 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:47.578194 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:47.586483 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] [instance: 707b8265-c1ce-4e8f-9fd2-df6140813b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:31:47.587756 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:47.588158 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:31:47.628664 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:31:47.629091 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-2c22f478-12b2-41e5-a154-100960bc2f0b tempest-TestNetworkBasicOps-307953513 tempest-TestNetworkBasicOps-307953513-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:32:07.181954 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:32:13.048973 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:32:14.067077 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 49116. Nov 25 15:32:35.901742 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:33:37.093746 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:33:37.960619 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:33:38.499997 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:33:38.979069 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 50178. Nov 25 15:33:43.069895 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:33:43.113701 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:43.114456 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:43.194887 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:43.196830 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:43.199856 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:43.200541 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:43.218261 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Getting quotas for project b72721926d404cab8ee81b2803086dfc. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:33:43.223133 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Getting quotas for user 6a981b9ddd2849db925425ed2c5917b0 and project b72721926d404cab8ee81b2803086dfc. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:33:43.235107 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] [instance: c3968374-639b-4f98-93bc-5b4040baddf1] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:33:43.236272 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:43.236680 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:43.243280 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] [instance: c3968374-639b-4f98-93bc-5b4040baddf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:33:43.244466 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:43.244994 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:43.272300 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:43.273253 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-424485ff-8f01-46ed-9067-695dda5a6d1b tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:51.097901 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:33:51.896898 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:33:51.919630 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:51.920152 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:51.969493 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:51.969897 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:51.970622 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:51.971047 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:51.986972 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Getting quotas for project c6268bafc24645df8be4c42f3a3d4593. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:33:51.991369 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Getting quotas for user dbb9b7ff2e944bf4923e68d47d186919 and project c6268bafc24645df8be4c42f3a3d4593. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:33:52.002350 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] [instance: 8086a1ab-0262-45df-be35-5652c2ddba3a] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:33:52.003254 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:52.003658 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:52.009475 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] [instance: 8086a1ab-0262-45df-be35-5652c2ddba3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:33:52.010651 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:52.011050 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:52.044993 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:33:52.045428 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-87ee7545-e89f-4437-af21-15dba821027c tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:33:52.124873 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 50330. Nov 25 15:34:24.010761 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:34:25.030203 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 50456. Nov 25 15:34:32.422841 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:34:33.439071 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 50474. Nov 25 15:35:04.092825 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:35:06.370866 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:35:14.066884 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:35:15.086137 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 50582. Nov 25 15:35:22.021632 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:35:22.045729 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:35:22.046141 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:35:22.111124 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:35:22.111522 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:35:22.112376 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:35:22.113028 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:35:22.131557 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Getting quotas for project c6268bafc24645df8be4c42f3a3d4593. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:35:22.136352 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Getting quotas for user dbb9b7ff2e944bf4923e68d47d186919 and project c6268bafc24645df8be4c42f3a3d4593. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:35:22.147245 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] [instance: 3bd23322-b955-4c76-ad1c-9fc4451ba020] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:35:22.148340 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:35:22.148837 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:35:22.156573 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] [instance: 3bd23322-b955-4c76-ad1c-9fc4451ba020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:35:22.158071 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:35:22.159765 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:35:22.194656 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:35:22.195756 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-2e3b68df-2040-4dee-95ca-82ee6f983eba tempest-TestSecurityGroupsBasicOps-1828438228 tempest-TestSecurityGroupsBasicOps-1828438228-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:35:27.206320 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:35:55.924081 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:36:13.309095 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-be5dac84-3d5c-4a28-b73d-321c31767dff tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method unshelve_instance {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:36:13.309798 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-be5dac84-3d5c-4a28-b73d-321c31767dff tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:36:13.317861 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-be5dac84-3d5c-4a28-b73d-321c31767dff tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:36:14.103327 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-be5dac84-3d5c-4a28-b73d-321c31767dff tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] [instance: c3968374-639b-4f98-93bc-5b4040baddf1] Requesting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) during scheduling {{(pid=89841) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Nov 25 15:36:14.475659 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-be5dac84-3d5c-4a28-b73d-321c31767dff tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:36:14.541869 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_db.api [None req-be5dac84-3d5c-4a28-b73d-321c31767dff tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 25 15:36:14.541869 n-d-819181-1 nova-conductor[89841]: [SQL: UPDATE instance_actions SET updated_at=%(updated_at)s WHERE instance_actions.id = %(instance_actions_id)s] Nov 25 15:36:14.541869 n-d-819181-1 nova-conductor[89841]: [parameters: {'updated_at': datetime.datetime(2021, 11, 25, 15, 36, 14, 494889), 'instance_actions_id': 417}] Nov 25 15:36:14.541869 n-d-819181-1 nova-conductor[89841]: (Background on this error at: http://sqlalche.me/e/13/e3q8) {{(pid=89841) _is_exception_expected /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:184}} Nov 25 15:36:14.543578 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_db.api [None req-be5dac84-3d5c-4a28-b73d-321c31767dff tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Performing DB retry for function nova.db.sqlalchemy.api.action_event_finish {{(pid=89841) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 25 15:36:19.992558 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:36:20.016846 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:36:20.017291 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:36:20.060803 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:36:20.061236 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:36:20.061955 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:36:20.062364 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:36:20.077052 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:36:20.081348 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for user 3234536972c94721be29764aded19278 and project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:36:20.091924 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 2b091120-4e16-4ad4-b083-3f3287f4c6e4] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:36:20.092819 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:36:20.093238 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:36:20.099899 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 2b091120-4e16-4ad4-b083-3f3287f4c6e4] block_device_mapping [BlockDeviceMapping(attachment_id=a95a29b4-9169-4c50-a251-a6db7d2721c0,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a079bfc1-7d2f-4a7f-883c-e6f6b4c875ee',volume_size=1,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:36:20.101465 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:36:20.101871 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:36:20.130764 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:36:20.131326 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ed3fbb6c-f9de-4c9e-9f5c-ff4d7c773743 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:37:19.131560 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:37:19.150643 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:37:19.151056 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:37:19.196236 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:37:19.196641 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:37:19.197446 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:37:19.197852 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:37:19.219188 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:37:19.224790 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for user 3234536972c94721be29764aded19278 and project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:37:19.232545 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 93bee7c6-9755-40bd-b22e-8668c219ca85] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:37:19.232878 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:37:19.233318 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:37:19.239739 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 93bee7c6-9755-40bd-b22e-8668c219ca85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5ec0020d-1ae3-45c5-82a9-108c37f1b7eb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:37:19.240899 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:37:19.241338 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:37:19.266667 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:37:19.267081 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98772e59-186b-4d34-bc9e-4c454433b889 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:37:33.439892 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:37:34.456354 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 51452. Nov 25 15:38:12.484507 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:38:12.508867 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.509313 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.520449 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:38:12.547216 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.547637 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.555427 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.555841 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.556623 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.557023 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.572855 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:38:12.578047 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for user 3234536972c94721be29764aded19278 and project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:38:12.588471 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 22e62ba6-f45d-4b13-88fb-0e85617eb11d] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:38:12.589437 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.589843 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.593002 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.593421 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.594231 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.594593 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.596961 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 22e62ba6-f45d-4b13-88fb-0e85617eb11d] block_device_mapping [BlockDeviceMapping(attachment_id=65174722-61be-4dfc-995d-34bcd7b282ad,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='515b35b8-f874-489a-81dd-47c566a30503',volume_size=1,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:38:12.598221 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.598625 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.611197 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Getting quotas for project b72721926d404cab8ee81b2803086dfc. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:38:12.616056 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Getting quotas for user 6a981b9ddd2849db925425ed2c5917b0 and project b72721926d404cab8ee81b2803086dfc. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:38:12.628020 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] [instance: 796e73a0-08eb-4fd6-9b47-65d7e494aa37] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:38:12.629821 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.630154 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.630252 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.630564 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-cb75906d-35eb-457f-bbd4-2f73ed9dfc91 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.639416 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] [instance: 796e73a0-08eb-4fd6-9b47-65d7e494aa37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:38:12.640733 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.641169 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:12.672056 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:12.672479 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0390e39a-763a-4ee1-a3e8-894e712a2372 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:15.087946 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:38:16.110006 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 51754. Nov 25 15:38:32.778633 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:38:32.800823 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:32.801260 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:32.858925 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:32.859327 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:32.860052 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:32.860439 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:32.877849 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:38:32.882421 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for user 3234536972c94721be29764aded19278 and project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:38:32.893195 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 2b3de88c-d254-4777-b74d-45e4e2602978] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:38:32.894086 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:32.894483 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:32.901492 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 2b3de88c-d254-4777-b74d-45e4e2602978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='dfe96e82-1c61-4a60-8ad7-6a17cd741868',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:38:32.902647 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:32.903114 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:32.934094 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:38:32.935008 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-9177501e-7663-486b-977c-7b2957ddbc20 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:38:47.232528 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:39:15.949648 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:39:29.990322 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Took 0.19 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:39:30.012598 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:39:30.013000 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:39:30.057047 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:39:30.057584 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:39:30.058389 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:39:30.058863 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:39:30.074784 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:39:30.079290 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for user 3234536972c94721be29764aded19278 and project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:39:30.090101 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 967cf40e-5f84-46c1-a06e-b109df906da2] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:39:30.091023 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:39:30.091432 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:39:30.098996 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 967cf40e-5f84-46c1-a06e-b109df906da2] block_device_mapping [BlockDeviceMapping(attachment_id=7a87b5f4-cff8-4bae-b8d8-2fcad3558656,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6463ff6-8475-47ea-8e00-8e23f780a07f',volume_size=1,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:39:30.100210 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:39:30.100617 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:39:30.130041 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:39:30.130449 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-994cd57d-5327-4b06-ab7d-57133847c991 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:40:34.457732 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:40:35.472507 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 52494. Nov 25 15:40:38.982929 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:40:40.002024 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 52532. Nov 25 15:40:40.042532 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f9e8aa5a-2f55-48fa-a256-7a2611aa4f13 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method unshelve_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:40:40.043024 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f9e8aa5a-2f55-48fa-a256-7a2611aa4f13 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:40:40.043524 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f9e8aa5a-2f55-48fa-a256-7a2611aa4f13 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:40:40.331373 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f9e8aa5a-2f55-48fa-a256-7a2611aa4f13 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] [instance: 796e73a0-08eb-4fd6-9b47-65d7e494aa37] Requesting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) during scheduling {{(pid=89840) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Nov 25 15:40:40.549215 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f9e8aa5a-2f55-48fa-a256-7a2611aa4f13 tempest-AttachVolumeShelveTestJSON-1129814613 tempest-AttachVolumeShelveTestJSON-1129814613-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:41:16.109119 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:41:17.125189 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 52638. Nov 25 15:41:51.809476 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:41:51.833175 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:41:51.833945 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:41:51.880108 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:41:51.880519 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:41:51.881311 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:41:51.881711 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:41:51.897944 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:41:51.902702 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for user 3234536972c94721be29764aded19278 and project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:41:51.913488 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 315b668d-fc54-48b7-bf18-9eda34965fc2] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:41:51.914442 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:41:51.914779 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:41:51.922108 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 315b668d-fc54-48b7-bf18-9eda34965fc2] block_device_mapping [BlockDeviceMapping(attachment_id=88b3658f-8b7d-4ee5-8f57-8bcaefc87b50,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6463ff6-8475-47ea-8e00-8e23f780a07f',volume_size=1,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:41:51.923436 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:41:51.923848 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:41:51.955308 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:41:51.955708 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-243d45e1-7c5d-4022-9910-76e6b7b36581 tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:42:07.258555 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:42:35.980033 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:42:50.147830 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:42:51.202181 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53442. Nov 25 15:43:35.473750 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:43:36.490476 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53648. Nov 25 15:43:37.137722 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:43:38.539469 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:43:40.002416 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:43:41.023260 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53666. Nov 25 15:43:52.124267 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:43:53.146147 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53704. Nov 25 15:44:07.228343 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:44:07.251319 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:44:07.251727 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:44:07.294897 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:44:07.295306 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:44:07.296031 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:44:07.296425 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:44:07.312779 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:44:07.317323 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Getting quotas for user 3234536972c94721be29764aded19278 and project 1ded488c019549909d922d7c8776bd72. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:44:07.328174 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 40b79853-46d4-4c27-9f13-7491ab3aaac7] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:44:07.329123 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:44:07.329523 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:44:07.336873 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] [instance: 40b79853-46d4-4c27-9f13-7491ab3aaac7] block_device_mapping [BlockDeviceMapping(attachment_id=e6a48505-80d8-4dbd-a26d-32c2c1d72c2f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c37041d9-2e21-4ea2-a02f-6ad147665787',volume_size=1,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:44:07.338142 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:44:07.338543 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:44:07.368444 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:44:07.368857 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ab7ef113-f7f7-4720-ab7b-61d1818c1b2e tempest-TestVolumeBootPattern-1046219474 tempest-TestVolumeBootPattern-1046219474-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:44:17.127460 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:44:18.146132 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 54056. Nov 25 15:44:25.036679 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:44:26.070080 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 54136. Nov 25 15:45:04.123980 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:45:06.401814 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:45:27.279110 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:45:56.009821 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:46:36.492666 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:46:37.511656 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55192. Nov 25 15:46:41.023946 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:46:42.045303 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55218. Nov 25 15:46:51.170943 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:46:52.192530 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55244. Nov 25 15:46:53.141920 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:46:54.168222 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55280. Nov 25 15:46:54.189567 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] [014de100-d6fb-4584-954f-50113b36ab5a] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 25 15:46:55.203411 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] [014de100-d6fb-4584-954f-50113b36ab5a] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55284. Nov 25 15:46:55.638432 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Took 1.45 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:46:55.661327 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:46:55.661741 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:46:55.710982 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:46:55.711314 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:46:55.712047 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:46:55.712443 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:46:55.727709 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Getting quotas for project 1a41b8b1aa2c4a0b8e32b8ddeb96fff5. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:46:55.732176 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Getting quotas for user fe29b002e6624c32a29eb5cec61e7e01 and project 1a41b8b1aa2c4a0b8e32b8ddeb96fff5. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:46:55.743516 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] [instance: dc4a659c-0050-46cd-8f4a-096baebd0f7f] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:46:55.744410 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:46:55.744814 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:46:55.750858 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] [instance: dc4a659c-0050-46cd-8f4a-096baebd0f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:46:55.752045 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:46:55.752450 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:46:55.778064 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:46:55.778472 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:46:55.786566 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] [5f3596d1-e891-493b-8a5b-763e3d526760] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 25 15:46:56.801171 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [None req-63c03c13-8a2b-4eb3-9f15-fca64d18c67d tempest-ServersAdminNegativeTestJSON-2147371024 tempest-ServersAdminNegativeTestJSON-2147371024-project] [5f3596d1-e891-493b-8a5b-763e3d526760] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55304. Nov 25 15:47:18.146123 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:47:19.166204 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55458. Nov 25 15:47:19.391006 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:47:19.415253 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:47:19.415660 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:47:19.462328 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:47:19.462639 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:47:19.463354 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:47:19.463739 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:47:19.478515 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Getting quotas for project 5a573c2ec69743e2a78a484ee86a592a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:47:19.482907 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Getting quotas for user 1dd71bb15c7f4d27a0ab8c3b2a58733a and project 5a573c2ec69743e2a78a484ee86a592a. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:47:19.493291 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] [instance: 3cf2780b-1bd3-4fb7-9b83-41005f210228] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:47:19.494162 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:47:19.494554 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:47:19.500556 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] [instance: 3cf2780b-1bd3-4fb7-9b83-41005f210228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:47:19.501786 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:47:19.502189 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:47:19.527693 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:47:19.528161 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-c3350e37-87a8-4729-a630-34633011a5f8 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:47:31.474295 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-d10142e2-74db-416e-80a0-7de90ba219b4 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:47:31.474796 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d10142e2-74db-416e-80a0-7de90ba219b4 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:47:31.475826 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d10142e2-74db-416e-80a0-7de90ba219b4 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:47:31.708170 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-d10142e2-74db-416e-80a0-7de90ba219b4 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] [instance: 3cf2780b-1bd3-4fb7-9b83-41005f210228] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89840) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 15:47:32.082465 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-d10142e2-74db-416e-80a0-7de90ba219b4 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] Created allocations for migration 1ba3779d-e2e0-412f-90d5-a9412d0812bd on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 15:47:32.280502 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-d10142e2-74db-416e-80a0-7de90ba219b4 tempest-DeleteServersTestJSON-855460391 tempest-DeleteServersTestJSON-855460391-project] [instance: 3cf2780b-1bd3-4fb7-9b83-41005f210228] Calling prep_resize with selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"c70a3c4d-08ee-470c-b8da-baacf1e5a82b": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c70a3c4d-08ee-470c-b8da-baacf1e5a82b"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=c70a3c4d-08ee-470c-b8da-baacf1e5a82b,limits=SchedulerLimits,nodename='n-h2-819181-1',service_host='n-h2-819181-1')] {{(pid=89840) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 15:48:16.665042 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:48:16.686641 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:48:16.687057 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:48:16.734669 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:48:16.735102 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:48:16.735847 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:48:16.736231 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:48:16.751866 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Getting quotas for project 90cddc1ff43c41fc98dc7032d10ed2cf. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:48:16.756471 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Getting quotas for user b7c6145072964729833d5e4c363fb167 and project 90cddc1ff43c41fc98dc7032d10ed2cf. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:48:16.766718 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] [instance: eea918a7-fbc0-40f0-bdcb-cdeb82ea0ab1] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:48:16.767613 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:48:16.768016 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:48:16.774729 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] [instance: eea918a7-fbc0-40f0-bdcb-cdeb82ea0ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:48:16.775932 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:48:16.776340 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:48:16.802849 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:48:16.803292 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-a8c0a547-eb15-4f97-a70c-f73d241a4e2f tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:48:29.630895 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-217737b8-9c8e-49a6-b566-2a08d7825d99 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:48:29.631562 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-217737b8-9c8e-49a6-b566-2a08d7825d99 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:48:29.631773 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-217737b8-9c8e-49a6-b566-2a08d7825d99 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:48:29.892983 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-217737b8-9c8e-49a6-b566-2a08d7825d99 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] [instance: eea918a7-fbc0-40f0-bdcb-cdeb82ea0ab1] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89840) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 15:48:30.241125 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-217737b8-9c8e-49a6-b566-2a08d7825d99 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Created allocations for migration 42fc8b96-de10-47b7-a32e-c8a7b5be109f on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 15:48:30.437952 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-217737b8-9c8e-49a6-b566-2a08d7825d99 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] [instance: eea918a7-fbc0-40f0-bdcb-cdeb82ea0ab1] Calling prep_resize with selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"8cc92976-9961-443c-adea-bbeeebbf35b2": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8cc92976-9961-443c-adea-bbeeebbf35b2"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=8cc92976-9961-443c-adea-bbeeebbf35b2,limits=SchedulerLimits,nodename='n-h1-819181-1',service_host='n-h1-819181-1')] {{(pid=89840) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 15:48:47.304341 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:49:14.914601 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:49:14.936780 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:49:14.937231 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:49:14.982736 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:49:14.983146 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:49:14.983885 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:49:14.984282 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:49:15.002783 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Getting quotas for project 90cddc1ff43c41fc98dc7032d10ed2cf. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:49:15.007832 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Getting quotas for user b7c6145072964729833d5e4c363fb167 and project 90cddc1ff43c41fc98dc7032d10ed2cf. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:49:15.018606 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] [instance: cd785c7e-c239-4c34-86fa-6907379fe982] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:49:15.019572 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:49:15.020125 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:49:15.027195 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] [instance: cd785c7e-c239-4c34-86fa-6907379fe982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:49:15.028399 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:49:15.028807 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:49:15.056278 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:49:15.056687 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-8e99ac9e-06f8-4e64-9011-d1a33abe5767 tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:49:16.031536 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:49:28.258065 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-d3627b79-8ca1-4fd4-bc10-1c172ed490cb tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:49:28.259789 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3627b79-8ca1-4fd4-bc10-1c172ed490cb tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:49:28.260193 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d3627b79-8ca1-4fd4-bc10-1c172ed490cb tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:49:28.415192 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-d3627b79-8ca1-4fd4-bc10-1c172ed490cb tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] [instance: cd785c7e-c239-4c34-86fa-6907379fe982] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89840) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 15:49:28.691095 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-d3627b79-8ca1-4fd4-bc10-1c172ed490cb tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] Created allocations for migration dcf33024-4cdf-40d6-a1bc-33c9b40304a6 on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 15:49:28.888042 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-d3627b79-8ca1-4fd4-bc10-1c172ed490cb tempest-ServerDiskConfigTestJSON-1202823198 tempest-ServerDiskConfigTestJSON-1202823198-project] [instance: cd785c7e-c239-4c34-86fa-6907379fe982] Calling prep_resize with selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"c70a3c4d-08ee-470c-b8da-baacf1e5a82b": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c70a3c4d-08ee-470c-b8da-baacf1e5a82b"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=c70a3c4d-08ee-470c-b8da-baacf1e5a82b,limits=SchedulerLimits,nodename='n-h2-819181-1',service_host='n-h2-819181-1')] {{(pid=89840) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 15:49:37.511692 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:49:38.527741 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55978. Nov 25 15:50:19.164349 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:50:20.181354 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56162. Nov 25 15:50:20.244536 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:50:20.266206 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:50:20.266619 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:50:20.314175 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:50:20.314498 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:50:20.315405 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:50:20.315795 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:50:20.331334 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Getting quotas for project 1119c444dd074d92bd05069967d80094. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:50:20.335732 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Getting quotas for user 17bde27bdd9746abadf48021c30ee4be and project 1119c444dd074d92bd05069967d80094. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:50:20.345699 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: cb4310f1-2291-4700-b851-e1c5003899a2] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:50:20.347200 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:50:20.347589 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:50:20.353546 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: cb4310f1-2291-4700-b851-e1c5003899a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:50:20.354681 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:50:20.355076 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:50:20.380801 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:50:20.381279 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-50eed9c8-2021-4812-a33c-875a99ebd46c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:51:42.048821 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:51:43.065730 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56328. Nov 25 15:51:52.188791 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:51:53.209637 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56350. Nov 25 15:51:57.169733 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:51:58.565676 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:52:07.322062 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:52:26.073865 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:52:27.089990 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56420. Nov 25 15:52:36.058369 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:52:38.528577 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:52:39.545558 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56446. Nov 25 15:52:54.162703 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:52:55.184154 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56486. Nov 25 15:52:59.243437 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-f349fe96-aad9-47dd-9240-7d0dc0ecbe3c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:52:59.244063 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f349fe96-aad9-47dd-9240-7d0dc0ecbe3c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:52:59.244373 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-f349fe96-aad9-47dd-9240-7d0dc0ecbe3c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:52:59.402858 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-f349fe96-aad9-47dd-9240-7d0dc0ecbe3c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: cb4310f1-2291-4700-b851-e1c5003899a2] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89840) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 15:52:59.784210 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-f349fe96-aad9-47dd-9240-7d0dc0ecbe3c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Created allocations for migration 0098c95a-1ba3-4a0e-ab87-ad4e2005b2f7 on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 15:53:00.137132 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-f349fe96-aad9-47dd-9240-7d0dc0ecbe3c tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: cb4310f1-2291-4700-b851-e1c5003899a2] Calling prep_resize with selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"c70a3c4d-08ee-470c-b8da-baacf1e5a82b": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c70a3c4d-08ee-470c-b8da-baacf1e5a82b"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=c70a3c4d-08ee-470c-b8da-baacf1e5a82b,limits=SchedulerLimits,nodename='n-h2-819181-1',service_host='n-h2-819181-1')] {{(pid=89840) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 15:53:20.181833 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:53:21.197528 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56584. Nov 25 15:53:24.152656 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:53:26.431246 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:53:30.094101 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Took 2.25 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:53:30.116762 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:53:30.117276 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:53:30.161242 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:53:30.161719 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:53:30.162577 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:53:30.162964 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:53:30.178817 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Getting quotas for project 1119c444dd074d92bd05069967d80094. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:53:30.183783 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Getting quotas for user 17bde27bdd9746abadf48021c30ee4be and project 1119c444dd074d92bd05069967d80094. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:53:30.193925 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: de8a5e57-8639-4ded-9193-d50eea5d9261] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:53:30.194841 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:53:30.195857 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:53:30.202143 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: de8a5e57-8639-4ded-9193-d50eea5d9261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:53:30.203287 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:53:30.203680 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:53:30.229491 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:53:30.229905 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-15b073cd-9c2e-45fe-b952-d0c724024a93 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:55:27.342960 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:55:35.412194 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-a002f95e-7684-445d-8706-113bf505b9b8 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:55:35.412868 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a002f95e-7684-445d-8706-113bf505b9b8 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:55:35.413416 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-a002f95e-7684-445d-8706-113bf505b9b8 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:55:35.684183 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-a002f95e-7684-445d-8706-113bf505b9b8 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: de8a5e57-8639-4ded-9193-d50eea5d9261] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89840) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 15:55:35.996776 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-a002f95e-7684-445d-8706-113bf505b9b8 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Created allocations for migration 5398c051-d284-4d66-9c60-b4cc8359c9a3 on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 15:55:36.203683 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-a002f95e-7684-445d-8706-113bf505b9b8 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: de8a5e57-8639-4ded-9193-d50eea5d9261] Calling prep_resize with selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"8cc92976-9961-443c-adea-bbeeebbf35b2": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8cc92976-9961-443c-adea-bbeeebbf35b2"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=8cc92976-9961-443c-adea-bbeeebbf35b2,limits=SchedulerLimits,nodename='n-h1-819181-1',service_host='n-h1-819181-1')] {{(pid=89840) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 15:55:39.545551 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:55:40.562227 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56920. Nov 25 15:55:55.180129 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:55:56.076848 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:55:56.204065 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56968. Nov 25 15:55:57.687215 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:55:57.711347 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:55:57.711738 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:55:57.772019 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:55:57.772019 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:55:57.772786 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:55:57.773216 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:55:57.794450 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Getting quotas for project 1119c444dd074d92bd05069967d80094. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:55:57.799182 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Getting quotas for user 17bde27bdd9746abadf48021c30ee4be and project 1119c444dd074d92bd05069967d80094. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:55:57.810692 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: f4c8c060-f67c-48d0-b6ae-86de8cb1a620] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:55:57.811591 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:55:57.812023 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:55:57.819881 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: f4c8c060-f67c-48d0-b6ae-86de8cb1a620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:55:57.821345 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:55:57.821766 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:55:57.855284 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:55:57.855670 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-ccbde87d-b8c5-4e93-baf9-a5e7ac3df57a tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:56:21.198167 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:56:22.215418 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57052. Nov 25 15:56:27.092822 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:56:28.110351 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57064. Nov 25 15:56:44.169760 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:56:46.452058 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:57:53.040213 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-983abe01-5dc4-46a4-95e9-4055ff396e92 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 15:57:53.040914 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-983abe01-5dc4-46a4-95e9-4055ff396e92 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:57:53.041254 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-983abe01-5dc4-46a4-95e9-4055ff396e92 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:57:53.305306 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-983abe01-5dc4-46a4-95e9-4055ff396e92 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: f4c8c060-f67c-48d0-b6ae-86de8cb1a620] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89841) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 15:57:53.642765 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-983abe01-5dc4-46a4-95e9-4055ff396e92 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Created allocations for migration 911676d7-96de-46a3-8e49-885d57eac28b on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 15:57:56.039997 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-983abe01-5dc4-46a4-95e9-4055ff396e92 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: f4c8c060-f67c-48d0-b6ae-86de8cb1a620] Calling prep_resize with selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"8cc92976-9961-443c-adea-bbeeebbf35b2": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8cc92976-9961-443c-adea-bbeeebbf35b2"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=8cc92976-9961-443c-adea-bbeeebbf35b2,limits=SchedulerLimits,nodename='n-h1-819181-1',service_host='n-h1-819181-1')] {{(pid=89841) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 15:58:32.807248 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 15:58:32.829762 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:58:32.830172 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:58:32.876010 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:58:32.876419 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:58:32.877196 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:58:32.877597 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:58:32.892886 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Getting quotas for project 1119c444dd074d92bd05069967d80094. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 15:58:32.897711 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Getting quotas for user 17bde27bdd9746abadf48021c30ee4be and project 1119c444dd074d92bd05069967d80094. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 15:58:32.908683 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: 4c47de15-cfc1-4c68-9680-baa907ca93ad] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 15:58:32.909626 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:58:32.910030 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:58:32.916984 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: 4c47de15-cfc1-4c68-9680-baa907ca93ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 15:58:32.918237 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:58:32.918662 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:58:32.948216 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 15:58:32.948647 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 15:58:32.958279 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [5f3596d1-e891-493b-8a5b-763e3d526760] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 25 15:58:33.974425 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [None req-8ea4be5c-3d75-4542-bd5f-f91056fc0597 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [5f3596d1-e891-493b-8a5b-763e3d526760] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57390. Nov 25 15:58:40.564275 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:58:41.581694 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57406. Nov 25 15:58:47.361837 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:59:16.099102 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 15:59:22.214596 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 15:59:23.240590 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57496. Nov 25 15:59:56.199817 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 15:59:57.221583 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57562. Nov 25 16:00:28.111851 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:00:29.129640 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57626. Nov 25 16:00:43.072379 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:00:44.088774 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57656. Nov 25 16:00:53.210850 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:00:54.233027 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57682. Nov 25 16:01:31.300924 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-bfadfe9b-12c6-49e6-8d20-ec1774ec1c48 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89841) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 16:01:31.301575 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bfadfe9b-12c6-49e6-8d20-ec1774ec1c48 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:01:31.302245 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bfadfe9b-12c6-49e6-8d20-ec1774ec1c48 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:01:31.423779 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-bfadfe9b-12c6-49e6-8d20-ec1774ec1c48 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: 4c47de15-cfc1-4c68-9680-baa907ca93ad] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89841) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 16:01:31.773016 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-bfadfe9b-12c6-49e6-8d20-ec1774ec1c48 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] Created allocations for migration d3e7d540-ab0a-4b4c-8c9a-27e079cb5181 on c70a3c4d-08ee-470c-b8da-baacf1e5a82b {{(pid=89841) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 16:01:34.012928 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.tasks.migrate [None req-bfadfe9b-12c6-49e6-8d20-ec1774ec1c48 tempest-ServerActionsTestJSON-180809094 tempest-ServerActionsTestJSON-180809094-project] [instance: 4c47de15-cfc1-4c68-9680-baa907ca93ad] Calling prep_resize with selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"c70a3c4d-08ee-470c-b8da-baacf1e5a82b": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c70a3c4d-08ee-470c-b8da-baacf1e5a82b"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=c70a3c4d-08ee-470c-b8da-baacf1e5a82b,limits=SchedulerLimits,nodename='n-h2-819181-1',service_host='n-h2-819181-1')] {{(pid=89841) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 16:01:41.582725 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:01:42.597522 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57824. Nov 25 16:02:07.381716 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:02:23.241723 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:02:24.257460 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57910. Nov 25 16:02:36.120252 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:02:44.028818 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:02:44.052420 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:44.052824 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:44.102765 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:44.103166 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:44.103887 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:44.104277 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:44.120337 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Getting quotas for project ccaceeb76ff94f209a2c86c5de712d9e. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:02:44.124872 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Getting quotas for user ea450ca9da014d038901873b4d6f73a7 and project ccaceeb76ff94f209a2c86c5de712d9e. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:02:44.135211 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] [instance: 3fc4d276-0124-44e6-b0ee-7306d346f558] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:02:44.136138 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:44.136537 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:44.142977 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] [instance: 3fc4d276-0124-44e6-b0ee-7306d346f558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:02:44.144143 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:44.144537 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:44.171565 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:44.172634 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:44.181169 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] [5f3596d1-e891-493b-8a5b-763e3d526760] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 25 16:02:45.196354 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [None req-c15300cc-1bbc-4af1-a10a-3672fb238006 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] [5f3596d1-e891-493b-8a5b-763e3d526760] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 58062. Nov 25 16:02:56.925449 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:02:56.948015 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:56.948406 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:56.991384 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:56.991712 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:56.992447 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:56.992849 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:57.008595 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Getting quotas for project ccaceeb76ff94f209a2c86c5de712d9e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:02:57.013152 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Getting quotas for user ea450ca9da014d038901873b4d6f73a7 and project ccaceeb76ff94f209a2c86c5de712d9e. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:02:57.023431 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] [instance: da330b56-21e1-440b-aa3b-58cbde937f22] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:02:57.024354 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:57.024758 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:57.031554 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] [instance: da330b56-21e1-440b-aa3b-58cbde937f22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:02:57.032890 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:57.033323 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:02:57.060248 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:02:57.060761 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-264713f6-6537-4a66-832a-fbde87ee8919 tempest-ServersNegativeTestJSON-966590477 tempest-ServersNegativeTestJSON-966590477-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:03:59.766021 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:03:59.788646 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:03:59.789180 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:03:59.843263 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:03:59.843668 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:03:59.844398 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:03:59.844803 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:03:59.860511 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Getting quotas for project 1aa13312629440ac967e36c3f3dd7ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:03:59.864850 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Getting quotas for user b077c3cb73034c6baba96ba1b8485c06 and project 1aa13312629440ac967e36c3f3dd7ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:03:59.876060 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] [instance: 2dff65a1-02fb-4418-a550-0a028fd89a49] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:03:59.876984 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:03:59.877413 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:03:59.884231 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] [instance: 2dff65a1-02fb-4418-a550-0a028fd89a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:03:59.885505 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:03:59.885907 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:03:59.911560 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:03:59.911959 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-d312faa9-6744-411f-bb59-b529f392761e tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:04:31.376319 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:04:31.398595 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:04:31.399047 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:04:31.442372 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:04:31.442776 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:04:31.443501 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:04:31.443894 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:04:31.459347 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Getting quotas for project 1aa13312629440ac967e36c3f3dd7ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:04:31.463766 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Getting quotas for user b077c3cb73034c6baba96ba1b8485c06 and project 1aa13312629440ac967e36c3f3dd7ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:04:31.474083 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] [instance: 57a22a63-4efc-4509-b965-4dace40e9fbd] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:04:31.474973 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:04:31.475380 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:04:31.481791 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] [instance: 57a22a63-4efc-4509-b965-4dace40e9fbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:04:31.482966 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:04:31.483367 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:04:31.509642 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:04:31.510048 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-053da96a-ee3c-42b6-9b0a-ddceb83967c9 tempest-TestEncryptedCinderVolumes-431463789 tempest-TestEncryptedCinderVolumes-431463789-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:04:42.598787 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:04:43.615163 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 58694. Nov 25 16:05:24.259501 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:05:25.300480 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 58900. Nov 25 16:05:27.402815 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:05:40.395966 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:05:40.418266 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:05:40.418687 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:05:40.478767 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:05:40.479246 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:05:40.479967 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:05:40.480355 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:05:40.496314 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Getting quotas for project fb976c9b62a0455db514613e20c11576. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:05:40.500909 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Getting quotas for user b3c3c440496c44419cc46bdc50768bfc and project fb976c9b62a0455db514613e20c11576. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:05:40.512059 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] [instance: ba248869-d63d-4d16-b7e7-12b28778d9f6] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:05:40.512986 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:05:40.513418 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:05:40.520080 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] [instance: ba248869-d63d-4d16-b7e7-12b28778d9f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b7c9718-0409-43df-b54c-f9a29a24581b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:05:40.521316 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:05:40.521714 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:05:40.553345 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:05:40.553751 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-efdabbca-b4e3-4379-865d-17bb7ae9a2a6 tempest-TestMinimumBasicScenario-1009115798 tempest-TestMinimumBasicScenario-1009115798-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:05:56.140108 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:06:44.200009 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:06:46.486526 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:06:57.220811 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:06:58.242190 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59156. Nov 25 16:07:29.134341 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:07:30.152241 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59186. Nov 25 16:07:43.615634 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:07:44.095008 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:07:44.631916 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59194. Nov 25 16:07:45.111229 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59196. Nov 25 16:07:54.232768 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:07:55.254241 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59200. Nov 25 16:08:25.296508 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:08:26.312533 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59210. Nov 25 16:08:37.224868 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:08:38.610717 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:08:47.429984 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:09:03.329929 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:09:03.352770 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:09:03.353119 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:09:03.405990 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:09:03.406389 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:09:03.407100 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:09:03.407487 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:09:03.423028 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:09:03.427756 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for user 2cb66fddcc3b4df09de9f4a74c043a42 and project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:09:03.438473 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: fe1729f2-c7b5-4714-9111-df4d548520e3] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:09:03.439410 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:09:03.439811 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:09:03.446500 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: fe1729f2-c7b5-4714-9111-df4d548520e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:09:03.447682 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:09:03.448080 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:09:03.477163 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:09:03.477588 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-e3b057d3-8b59-46e9-9d1a-83cb2882d21c tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:09:16.160556 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:10:18.040026 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:10:18.065185 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:10:18.065601 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:10:18.111391 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:10:18.111807 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:10:18.112540 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:10:18.112940 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:10:18.128853 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:10:18.133383 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for user 2cb66fddcc3b4df09de9f4a74c043a42 and project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:10:18.143912 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: b2612640-02ea-40db-8d00-10b0632942e5] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:10:18.144835 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:10:18.145352 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:10:18.152337 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: b2612640-02ea-40db-8d00-10b0632942e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:10:18.153551 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:10:18.153957 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:10:18.179906 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:10:18.180319 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-bb2411d2-f938-4e20-a211-010b53efef80 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:10:44.632645 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:10:45.648675 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59790. Nov 25 16:11:26.312609 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:11:27.328471 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59804. Nov 25 16:11:30.152785 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:11:31.168426 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59808. Nov 25 16:11:44.219763 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:11:46.507873 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:11:58.240029 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:11:59.261424 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59856. Nov 25 16:12:07.450142 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:12:36.181453 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:12:45.114097 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:12:46.130728 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59882. Nov 25 16:12:55.251981 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:12:56.281059 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59908. Nov 25 16:13:14.281227 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:13:14.302917 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:13:14.303332 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:13:14.348638 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:13:14.349038 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:13:14.349788 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:13:14.350176 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:13:14.365785 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:13:14.370978 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for user 2cb66fddcc3b4df09de9f4a74c043a42 and project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:13:14.381404 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: 69add979-20ce-4ff5-8cf7-d46222121556] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:13:14.382317 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:13:14.382713 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:13:14.389856 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: 69add979-20ce-4ff5-8cf7-d46222121556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:13:14.391029 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:13:14.391428 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:13:14.419943 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:13:14.420278 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-0c0f57ab-7932-42b5-adb0-65d0420d3f66 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:13:37.249160 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:13:45.650048 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:13:46.664822 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60082. Nov 25 16:14:02.114641 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-c64e16a5-1fab-4e5e-90bf-bd855ac5c384 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method migrate_server {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 16:14:02.115249 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c64e16a5-1fab-4e5e-90bf-bd855ac5c384 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:14:02.115516 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-c64e16a5-1fab-4e5e-90bf-bd855ac5c384 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:14:02.297820 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-c64e16a5-1fab-4e5e-90bf-bd855ac5c384 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: 69add979-20ce-4ff5-8cf7-d46222121556] Restricting to cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) while migrating {{(pid=89840) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Nov 25 16:14:02.654728 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-c64e16a5-1fab-4e5e-90bf-bd855ac5c384 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Created allocations for migration 9fb6f6a3-8e95-4a89-a2c8-529d94317a1b on 8cc92976-9961-443c-adea-bbeeebbf35b2 {{(pid=89840) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Nov 25 16:14:02.856130 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.tasks.migrate [None req-c64e16a5-1fab-4e5e-90bf-bd855ac5c384 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: 69add979-20ce-4ff5-8cf7-d46222121556] Calling prep_resize with selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [Selection(allocation_request='{"allocations": {"8cc92976-9961-443c-adea-bbeeebbf35b2": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8cc92976-9961-443c-adea-bbeeebbf35b2"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ce0c8c10-e039-42df-9196-4e8db3440bd7,compute_node_uuid=8cc92976-9961-443c-adea-bbeeebbf35b2,limits=SchedulerLimits,nodename='n-h1-819181-1',service_host='n-h1-819181-1')] {{(pid=89840) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Nov 25 16:14:27.328919 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:14:28.344431 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60182. Nov 25 16:15:27.468073 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:15:31.171406 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:15:32.189396 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60292. Nov 25 16:15:39.384401 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:15:39.407201 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:15:39.407608 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:15:39.448849 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:15:39.449305 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:15:39.450048 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:15:39.450445 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:15:39.466282 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:15:39.471617 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for user 2cb66fddcc3b4df09de9f4a74c043a42 and project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:15:39.482055 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: 8023dec2-3640-4c1a-9aa0-3b9f64319f6e] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:15:39.483026 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:15:39.483432 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:15:39.489563 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: 8023dec2-3640-4c1a-9aa0-3b9f64319f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:15:39.490745 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:15:39.491145 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:15:39.517761 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:15:39.518144 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbb8a694-8e16-45f6-8c5e-5eddf557c544 tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:15:56.203189 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:16:46.132812 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:16:46.665789 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:16:47.147178 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60404. Nov 25 16:16:47.680990 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60406. Nov 25 16:16:56.275738 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:16:57.267088 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:16:57.303380 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60420. Nov 25 16:16:58.637686 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:17:28.344602 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:17:29.359873 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60474. Nov 25 16:17:59.260746 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:18:00.280695 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60488. Nov 25 16:18:24.243426 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:18:26.535440 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:18:32.190842 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:18:32.834216 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:18:32.855717 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:18:32.856205 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:18:32.902255 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:18:32.902666 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:18:32.903402 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:18:32.903979 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:18:32.919161 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:18:32.924263 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Getting quotas for user 2cb66fddcc3b4df09de9f4a74c043a42 and project 00c13147035a4ba8abfd75cccde6d0ef. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:18:32.934644 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: cf3351ba-498d-4d8e-86b2-1c0d9e397ded] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:18:32.935610 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:18:32.936017 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:18:32.943441 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] [instance: cf3351ba-498d-4d8e-86b2-1c0d9e397ded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:18:32.944659 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:18:32.945090 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:18:32.972204 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:18:32.972612 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-1032235e-ea97-4a2e-978d-7778085c6a1f tempest-TestNetworkAdvancedServerOps-1243806410 tempest-TestNetworkAdvancedServerOps-1243806410-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:18:33.208190 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60634. Nov 25 16:18:47.493728 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:19:16.224056 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:19:47.682573 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:19:48.698616 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60714. Nov 25 16:20:29.360952 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:20:30.383067 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60896. Nov 25 16:20:34.813380 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:20:34.835132 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:20:34.835536 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:20:34.882691 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:20:34.883098 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:20:34.883818 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:20:34.884210 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:20:34.899892 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Getting quotas for project f42612ff5e6c4c29be95a4b2d9ce6672. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:20:34.904369 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Getting quotas for user eb489a240c384e0282cbc2b474cd0ec7 and project f42612ff5e6c4c29be95a4b2d9ce6672. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:20:34.915534 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] [instance: 4e9dcc26-07d0-4299-a66b-849f3abf1fbf] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:20:34.916430 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:20:34.916849 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:20:34.922780 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] [instance: 4e9dcc26-07d0-4299-a66b-849f3abf1fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:20:34.923934 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:20:34.924331 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:20:34.948937 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:20:34.949457 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-02645b52-9266-4b65-8c7e-c5f3d0c110a7 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:20:47.151075 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:20:48.167128 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60992. Nov 25 16:20:57.297778 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:20:58.319366 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 32772. Nov 25 16:22:07.516467 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:22:36.244817 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:22:48.699558 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:22:49.716062 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 32796. Nov 25 16:23:00.278767 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:23:01.299340 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 32800. Nov 25 16:23:24.265936 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:23:26.559575 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:23:30.381687 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:23:31.398717 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 32862. Nov 25 16:23:33.210243 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:23:34.226777 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 32884. Nov 25 16:23:37.303629 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:23:38.660277 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:23:46.635241 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7956f795-76b8-40c8-ad00-9d059a39a96c tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method unshelve_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 16:23:46.635909 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7956f795-76b8-40c8-ad00-9d059a39a96c tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:23:46.636265 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-7956f795-76b8-40c8-ad00-9d059a39a96c tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:23:46.860282 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7956f795-76b8-40c8-ad00-9d059a39a96c tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] [instance: 4e9dcc26-07d0-4299-a66b-849f3abf1fbf] Requesting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) during scheduling {{(pid=89840) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Nov 25 16:23:47.243897 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-7956f795-76b8-40c8-ad00-9d059a39a96c tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:25:27.534382 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:25:47.624672 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:25:47.647864 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:25:47.648280 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:25:47.693506 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:25:47.693912 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:25:47.694632 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:25:47.695029 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:25:47.710121 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Getting quotas for project f42612ff5e6c4c29be95a4b2d9ce6672. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:25:47.714546 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Getting quotas for user eb489a240c384e0282cbc2b474cd0ec7 and project f42612ff5e6c4c29be95a4b2d9ce6672. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:25:47.725379 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] [instance: 3ee27035-473a-45cb-88fd-1c404b8bbf1d] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:25:47.726262 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:25:47.726663 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:25:47.732985 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] [instance: 3ee27035-473a-45cb-88fd-1c404b8bbf1d] block_device_mapping [BlockDeviceMapping(attachment_id=46dfeede-83ad-4fdc-a022-c73628cb27ce,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aab04e74-1754-4721-88dc-0a370ff3cac6',volume_size=1,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:25:47.734172 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:25:47.734571 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:25:47.761061 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:25:47.761513 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-bbfd51d3-d6b5-48b3-beb7-35a17fb311ed tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:25:48.169981 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:25:49.187916 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33236. Nov 25 16:25:49.719802 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:25:50.738963 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33244. Nov 25 16:25:56.264059 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:25:58.317758 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:25:59.339571 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33264. Nov 25 16:26:31.401586 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:26:32.414794 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33306. Nov 25 16:26:57.330934 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:26:58.692590 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:28:01.298012 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:28:02.319582 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33326. Nov 25 16:28:21.428070 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-553bbef6-6419-4e3c-8110-10f79da82222 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Targeting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) for conductor method unshelve_instance {{(pid=89840) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Nov 25 16:28:21.428903 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-553bbef6-6419-4e3c-8110-10f79da82222 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:28:21.429618 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-553bbef6-6419-4e3c-8110-10f79da82222 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:28:21.536475 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-553bbef6-6419-4e3c-8110-10f79da82222 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] [instance: 3ee27035-473a-45cb-88fd-1c404b8bbf1d] Requesting cell ce0c8c10-e039-42df-9196-4e8db3440bd7(cell1) during scheduling {{(pid=89840) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Nov 25 16:28:21.781060 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-553bbef6-6419-4e3c-8110-10f79da82222 tempest-TestShelveInstance-183411610 tempest-TestShelveInstance-183411610-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:28:24.287407 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:28:26.582508 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:28:34.229037 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:28:35.247369 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33410. Nov 25 16:28:47.554114 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:28:50.739391 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:28:51.762831 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33430. Nov 25 16:29:16.286346 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:29:32.415682 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:29:33.431588 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33444. Nov 25 16:30:33.777110 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89841) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:30:33.822428 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:30:33.823053 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:30:33.907830 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:30:33.908935 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:30:33.910202 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:30:33.910869 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:30:33.946438 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Getting quotas for project 389dc59df27d48d5a6f51e67abe7ec52. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:30:33.952333 n-d-819181-1 nova-conductor[89841]: DEBUG nova.quota [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Getting quotas for user 6b6c939798e444dfbd003ba54c9d60b2 and project 389dc59df27d48d5a6f51e67abe7ec52. Resources: {'ram', 'cores', 'instances'} {{(pid=89841) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:30:33.967381 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] [instance: 04f9ea4a-6a3f-47e3-8c5a-3aafe9d65245] Selected host: n-h2-819181-1; Selected node: n-h2-819181-1; Alternates: [('n-h1-819181-1', 'n-h1-819181-1')] {{(pid=89841) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:30:33.968334 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:30:33.968742 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:30:33.976973 n-d-819181-1 nova-conductor[89841]: DEBUG nova.conductor.manager [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] [instance: 04f9ea4a-6a3f-47e3-8c5a-3aafe9d65245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56ed9b02-bb63-4573-b62f-bb0361457a50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89841) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:30:33.978324 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:30:33.978727 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:30:34.014898 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:30:34.015597 n-d-819181-1 nova-conductor[89841]: DEBUG oslo_concurrency.lockutils [None req-98cf2796-8c14-4c69-8439-ca9ba0378ef2 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:30:49.192502 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:30:50.211328 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33702. Nov 25 16:30:59.336956 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:31:00.358401 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33714. Nov 25 16:31:51.764200 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:31:52.782790 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33732. Nov 25 16:32:07.581614 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:32:33.432825 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:32:34.447591 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33738. Nov 25 16:32:35.250615 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:32:36.266609 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33740. Nov 25 16:32:36.307878 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:33:02.317043 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:33:03.338753 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33746. Nov 25 16:33:24.313457 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:33:26.608750 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:33:37.359177 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:33:38.228745 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89840) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Nov 25 16:33:38.253938 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:33:38.254346 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:33:38.325828 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:33:38.326229 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:33:38.326987 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:33:38.327383 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:33:38.344313 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Getting quotas for project 389dc59df27d48d5a6f51e67abe7ec52. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 16:33:38.349034 n-d-819181-1 nova-conductor[89840]: DEBUG nova.quota [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Getting quotas for user 6b6c939798e444dfbd003ba54c9d60b2 and project 389dc59df27d48d5a6f51e67abe7ec52. Resources: {'ram', 'cores', 'instances'} {{(pid=89840) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 16:33:38.362892 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] [instance: 56ca91d6-b039-4d51-83c8-3b97efc9d937] Selected host: n-h1-819181-1; Selected node: n-h1-819181-1; Alternates: [('n-h2-819181-1', 'n-h2-819181-1')] {{(pid=89840) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Nov 25 16:33:38.363848 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:33:38.364225 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:33:38.372998 n-d-819181-1 nova-conductor[89840]: DEBUG nova.conductor.manager [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] [instance: 56ca91d6-b039-4d51-83c8-3b97efc9d937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99a950dc-67f6-4cba-b55f-6e3e704fd1eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89840) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Nov 25 16:33:38.374857 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:33:38.375583 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:33:38.408247 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 25 16:33:38.408646 n-d-819181-1 nova-conductor[89840]: DEBUG oslo_concurrency.lockutils [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] Lock "ce0c8c10-e039-42df-9196-4e8db3440bd7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 25 16:33:38.417683 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] [5f3596d1-e891-493b-8a5b-763e3d526760] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 25 16:33:39.432830 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [None req-80004bfc-cedf-4ed7-9623-f2306547b432 tempest-TestSnapshotPattern-1814469086 tempest-TestSnapshotPattern-1814469086-project] [5f3596d1-e891-493b-8a5b-763e3d526760] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33904. Nov 25 16:34:52.784395 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:34:53.800706 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33996. Nov 25 16:35:27.606525 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:35:34.450220 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:35:35.466527 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34014. Nov 25 16:35:36.268151 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:35:37.285757 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34020. Nov 25 16:35:50.213414 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:35:51.244202 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34126. Nov 25 16:35:56.329013 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:36:00.356614 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:36:01.389460 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34212. Nov 25 16:36:03.335455 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:36:04.370699 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34232. Nov 25 16:36:44.331881 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:36:46.632379 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:36:57.381253 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:37:53.800849 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:37:54.816348 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34300. Nov 25 16:38:35.466589 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:38:36.481858 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34308. Nov 25 16:38:37.286805 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:38:38.302989 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34312. Nov 25 16:38:39.446985 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:38:47.625916 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:38:51.242966 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:38:52.261045 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34326. Nov 25 16:39:01.383594 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:39:02.406391 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34334. Nov 25 16:39:04.360830 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:39:05.384570 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34336. Nov 25 16:39:16.357548 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:40:04.350613 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:40:06.651392 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:40:17.399464 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:40:54.816671 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:40:55.833648 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34360. Nov 25 16:41:36.483734 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:41:37.501566 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34362. Nov 25 16:41:38.304897 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:41:39.320463 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34364. Nov 25 16:41:52.261198 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:41:53.276604 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34366. Nov 25 16:41:59.468133 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:42:02.401059 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:42:03.422476 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [faf5fa6b-0418-4e30-8067-db78f7125cfd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34374. Nov 25 16:42:05.378745 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:42:06.402815 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd8e4262-0ae3-4b61-b6a8-71df79a7b121] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34376. Nov 25 16:42:07.648508 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:42:36.379421 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:43:24.368958 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:43:26.670832 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:43:37.422783 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 16:43:55.833718 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:43:56.853321 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba5e8-62e8-417c-b80d-7ef71326bf1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34406. Nov 25 16:44:37.501812 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:44:38.518508 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [6677946a-b2b1-4808-a3c5-945df8ba1ebe] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34408. Nov 25 16:44:39.322446 n-d-819181-1 nova-conductor[89841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 16:44:40.339245 n-d-819181-1 nova-conductor[89841]: INFO oslo.messaging._drivers.impl_rabbit [-] [918d810d-a3e9-4728-a73c-d513b3f121c6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34410. Nov 25 16:44:53.280097 n-d-819181-1 nova-conductor[89840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] AMQP server on 10.222.0.65:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 25 16:44:54.307809 n-d-819181-1 nova-conductor[89840]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3c74ae-4191-4a51-9b7e-bb8c5bba4f18] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34412.