-- Logs begin at Thu 2021-07-08 07:09:41 UTC, end at Thu 2021-07-08 10:27:42 UTC. -- Jul 08 08:02:34.768442 chdv-799894-1 systemd[1]: Started Devstack devstack@n-super-cond.service. Jul 08 08:02:37.937406 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jul 08 08:02:38.166503 chdv-799894-1 nova-conductor[81125]: DEBUG nova.context [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) {{(pid=81125) load_cells /opt/stack/nova/nova/context.py:465}} Jul 08 08:02:38.170170 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_concurrency.lockutils [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=81125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:02:38.171625 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_concurrency.lockutils [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=81125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:02:38.172363 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_concurrency.lockutils [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=81125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:02:38.174094 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_concurrency.lockutils [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=81125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:02:38.204264 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jul 08 08:02:38.205293 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jul 08 08:02:38.219263 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_concurrency.lockutils [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Acquired lock "singleton_lock" {{(pid=81125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 08 08:02:38.219768 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_concurrency.lockutils [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Releasing lock "singleton_lock" {{(pid=81125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 08 08:02:38.220540 chdv-799894-1 nova-conductor[81125]: INFO oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Starting 2 workers Jul 08 08:02:38.225295 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Started child 82010 {{(pid=81125) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Jul 08 08:02:38.229960 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Started child 82011 {{(pid=81125) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Jul 08 08:02:38.231119 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Full set of CONF: {{(pid=81125) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Jul 08 08:02:38.231516 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ******************************************************************************** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2567}} Jul 08 08:02:38.231841 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] Configuration options gathered from: {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2568}} Jul 08 08:02:38.232244 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2569}} Jul 08 08:02:38.232908 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] config files: ['/etc/nova/nova.conf'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2570}} Jul 08 08:02:38.233224 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ================================================================================ {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2572}} Jul 08 08:02:38.233939 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] allow_resize_to_same_host = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.234432 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] arq_binding_timeout = 300 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.234779 chdv-799894-1 nova-conductor[82010]: INFO nova.service [-] Starting conductor node (version 22.2.2) Jul 08 08:02:38.235286 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] bandwidth_poll_interval = 600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.235360 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] bindir = /usr/local/bin {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.235738 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] block_device_allocate_retries = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.236181 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] block_device_allocate_retries_interval = 3 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.236652 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cert = self.pem {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.237041 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute_driver = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.242331 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute_monitors = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.242917 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] config_dir = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.243403 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] config_drive_format = iso9660 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.243745 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.244190 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] config_source = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.244680 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] console_host = chdv-799894-1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.245124 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] control_exchange = nova {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.245590 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cpu_allocation_ratio = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.245996 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] daemon = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.249036 chdv-799894-1 nova-conductor[82011]: INFO nova.service [-] Starting conductor node (version 22.2.2) Jul 08 08:02:38.250960 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] debug = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.251429 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] default_access_ip_network_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.251870 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] default_availability_zone = nova {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.252384 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] default_ephemeral_format = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.252930 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.254011 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] default_schedule_zone = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.255860 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] disk_allocation_ratio = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.257841 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] enable_new_services = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.261819 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] enabled_apis = ['osapi_compute'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.261819 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] enabled_ssl_apis = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.261819 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] flat_injected = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.261819 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] force_config_drive = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.264827 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] force_raw_images = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.265329 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] graceful_shutdown_timeout = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.265730 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] heal_instance_info_cache_interval = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.266144 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] host = chdv-799894-1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.266595 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.266988 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] initial_disk_allocation_ratio = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.272560 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] initial_ram_allocation_ratio = 1.5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.273101 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.273528 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] instance_build_timeout = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.273917 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] instance_delete_interval = 300 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.274344 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] instance_format = [instance: %(uuid)s] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.274738 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] instance_name_template = instance-%08x {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.275251 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] instance_usage_audit = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.275582 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] instance_usage_audit_period = month {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.275972 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.276605 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] instances_path = /opt/stack/data/nova/instances {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.276994 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] internal_service_availability_zone = internal {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.277389 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] key = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.277772 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] live_migration_retry_count = 30 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.278185 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] log_config_append = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.278572 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.279873 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] log_dir = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.279873 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] log_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.280056 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] log_options = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.280325 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] log_rotate_interval = 1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.280833 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] log_rotate_interval_type = days {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.281189 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] log_rotation_type = none {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.281585 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.281833 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.282245 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.284435 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.284435 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.284435 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] long_rpc_timeout = 1800 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.284435 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] max_concurrent_builds = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.284435 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] max_concurrent_live_migrations = 1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.284801 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] max_concurrent_snapshots = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.285135 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] max_local_block_devices = 3 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.285314 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] max_logfile_count = 30 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.285693 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] max_logfile_size_mb = 200 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.286102 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] maximum_instance_delete_attempts = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.286503 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] metadata_listen = 0.0.0.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.287148 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] metadata_listen_port = 8775 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.287537 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] metadata_workers = 2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.287912 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] migrate_max_retries = -1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.288298 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] mkisofs_cmd = genisoimage {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.292508 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] my_block_storage_ip = 10.222.0.50 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.292508 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] my_ip = 10.222.0.50 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.292508 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] network_allocate_retries = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.292985 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.292985 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] osapi_compute_listen = 0.0.0.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.293320 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] osapi_compute_listen_port = 8774 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.293722 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] osapi_compute_unique_server_name_scope = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.294117 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] osapi_compute_workers = 2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.294516 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] password_length = 12 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.295081 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_db.sqlalchemy.engines [None req-95aa56e4-a44a-4029-8837-11486f6443e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jul 08 08:02:38.296042 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] periodic_enable = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.296630 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] periodic_fuzzy_delay = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.297176 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] pointer_model = usbtablet {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.297906 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] preallocate_images = none {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.300408 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] publish_errors = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.309073 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] pybasedir = /opt/stack/nova {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.310604 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ram_allocation_ratio = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.311571 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] rate_limit_burst = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.312478 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] rate_limit_except_level = CRITICAL {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.313314 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] rate_limit_interval = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.314114 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] reboot_timeout = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.315539 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ac0549-ad09-475f-860e-0f18594c850f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jul 08 08:02:38.316097 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] reclaim_instance_interval = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.319380 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] record = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.320809 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] report_interval = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.328918 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] rescue_timeout = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.329850 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] reserved_host_cpus = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.330480 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] reserved_host_disk_mb = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.331085 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] reserved_host_memory_mb = 512 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.331713 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] reserved_huge_pages = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.332291 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] resize_confirm_window = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.333171 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] resize_fs_using_block_device = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.334297 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] resume_guests_state_on_host_boot = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.334898 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.335510 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] rpc_response_timeout = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.336090 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] run_external_periodic_tasks = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.336726 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] running_deleted_instance_action = reap {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.337323 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] running_deleted_instance_poll_interval = 1800 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.337891 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] running_deleted_instance_timeout = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.338464 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler_instance_sync_interval = 120 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.339031 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_down_time = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.339634 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] servicegroup_driver = db {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.340225 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] shelved_offload_time = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.340845 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] shelved_poll_interval = 3600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.341433 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] shutdown_timeout = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355188 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] source_is_ipv6 = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355188 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ssl_only = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355188 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] state_path = /opt/stack/data/nova {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355188 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] sync_power_state_interval = 600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355188 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] sync_power_state_pool_size = 1000 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355188 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] syslog_log_facility = LOG_USER {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355188 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] tempdir = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355782 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] timeout_nbd = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355782 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] transport_url = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355782 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] update_resources_interval = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355782 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] use_cow_images = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355782 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] use_eventlog = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355782 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] use_journal = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.355782 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] use_json = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356469 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] use_rootwrap_daemon = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356469 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] use_stderr = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356469 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] use_syslog = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356469 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vcpu_pin_set = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356469 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vif_plugging_is_fatal = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356469 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vif_plugging_timeout = 300 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356469 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] virt_mkfs = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356975 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] volume_usage_poll_interval = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356975 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] watch_log_file = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356975 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] web = /usr/share/spice-html5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Jul 08 08:02:38.356975 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_concurrency.disable_process_locking = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.356975 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.356975 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.auth_strategy = keystone {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.357418 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.compute_link_prefix = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.357418 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.357418 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.dhcp_domain = novalocal {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.357418 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.enable_instance_password = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.357418 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.glance_link_prefix = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.357418 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.357850 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.357850 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.instance_list_per_project_cells = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.358093 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.list_records_by_skipping_down_cells = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.358713 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.local_metadata_per_cell = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.359242 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.max_limit = 1000 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.359711 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.metadata_cache_expiration = 15 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.360214 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.neutron_default_tenant_id = default {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.360699 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.use_forwarded_for = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.361161 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.use_neutron_default_nets = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.361625 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.362081 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.362556 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.363029 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.363525 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.vendordata_dynamic_targets = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.364601 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.vendordata_jsonfile_path = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.365667 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.366244 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.backend = dogpile.cache.memcached {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.366741 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.backend_argument = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.367257 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.config_prefix = cache.oslo {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.367872 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.debug_cache_backend = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.368365 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.enabled = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.368882 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.expiration_time = 600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.369345 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.memcache_dead_retry = 300 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.369801 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.370267 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.memcache_pool_maxsize = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.370725 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.371226 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.371690 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.memcache_socket_timeout = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.372177 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.proxies = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.372659 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.tls_allowed_ciphers = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.373104 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.tls_cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.373693 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.tls_certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.374145 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.tls_enabled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.374610 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cache.tls_keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.375137 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.auth_section = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.375623 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.auth_type = password {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.376072 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.376738 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.catalog_info = volumev3::publicURL {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.377190 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.377683 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.378157 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.cross_az_attach = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.378637 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.endpoint_template = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.379101 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.http_retries = 3 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.379559 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.381189 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.385682 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.os_region_name = RegionOne {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.385682 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.385682 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cinder.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.385682 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.385682 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute.cpu_dedicated_set = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.385682 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute.cpu_shared_set = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.385682 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.386681 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute.max_concurrent_disk_ops = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.386681 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute.max_disk_devices_to_attach = -1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.386681 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.386681 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute.resource_provider_association_refresh = 300 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.386681 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] compute.shutdown_retry_interval = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.386681 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] conductor.workers = 2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.387467 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] console.allowed_origins = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.387467 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] console.ssl_ciphers = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.387467 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] console.ssl_minimum_version = default {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.387889 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] consoleauth.token_ttl = 600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.388305 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.388711 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.389091 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.389631 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.connect_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.389862 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.connect_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.390242 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.endpoint_override = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.390627 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.391001 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.391386 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.max_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.391764 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.min_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.392142 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.region_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.392547 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.service_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.392946 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.service_type = accelerator {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.393330 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.393711 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.status_code_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.394089 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.status_code_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.394466 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.394922 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.395430 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] cyborg.version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.396367 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.backend = sqlalchemy {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.396795 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.connection = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.397199 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.connection_debug = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.397609 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.connection_parameters = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.398032 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.connection_recycle_time = 3600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.398426 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.connection_trace = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.398819 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.db_inc_retry_interval = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.399217 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.db_max_retries = 20 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.399763 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.db_max_retry_interval = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.399985 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.db_retry_interval = 1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.400542 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.max_overflow = 50 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.400814 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.max_pool_size = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.401224 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.max_retries = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.401574 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.mysql_enable_ndb = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.401993 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.402378 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.pool_timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.402774 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.retry_interval = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.403158 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.slave_connection = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.403557 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.sqlite_synchronous = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.403950 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.use_db_reconnect = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.404367 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] database.use_tpool = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.404957 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.connection = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.405351 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.connection_debug = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.405785 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.connection_parameters = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.406386 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.connection_recycle_time = 3600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.406808 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.connection_trace = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.407194 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.max_overflow = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.409644 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.max_pool_size = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.409644 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.max_retries = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.409644 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.409644 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.pool_timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.409644 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.retry_interval = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.409644 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.slave_connection = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.411302 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] api_database.sqlite_synchronous = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.411302 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] devices.enabled_vgpu_types = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.411302 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.412695 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ephemeral_storage_encryption.enabled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.412695 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.412695 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.allowed_direct_url_schemes = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.413141 chdv-799894-1 nova-conductor[82010]: DEBUG nova.service [None req-95aa56e4-a44a-4029-8837-11486f6443e5 None None] Creating RPC server for service conductor {{(pid=82010) start /opt/stack/nova/nova/service.py:182}} Jul 08 08:02:38.413293 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.api_servers = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.413293 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.413698 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.414550 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.414550 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.connect_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.414932 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.connect_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.415774 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.debug = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.415774 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.default_trusted_certificate_ids = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.415999 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.enable_certificate_validation = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420152 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.enable_rbd_download = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420152 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.endpoint_override = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420152 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420152 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420152 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.max_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420152 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.min_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420152 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.num_retries = 3 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420711 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.rbd_ceph_conf = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420711 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.rbd_connect_timeout = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420711 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.rbd_pool = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420711 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.rbd_user = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.420944 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.region_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.421279 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.service_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.421820 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.service_type = image {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.422371 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.422899 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.status_code_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.423535 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.status_code_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.424078 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.424695 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.425285 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.verify_glance_signatures = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.425821 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] glance.version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.426928 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] guestfs.debug = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.428203 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.config_drive_cdrom = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.428858 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.config_drive_inject_password = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.429433 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.430197 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.enable_instance_metrics_collection = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.430821 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.enable_remotefx = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.431431 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.instances_path_share = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.432013 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.iscsi_initiator_list = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.432882 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.limit_cpu_features = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.433472 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.434055 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.434619 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.power_state_check_timeframe = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.435256 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.435850 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.436444 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.use_multipath_io = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.437020 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.volume_attach_retry_count = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.437628 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.438209 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.vswitch_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.438801 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.439427 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] mks.enabled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.440808 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.441429 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] image_cache.manager_interval = 2400 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.442065 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] image_cache.precache_concurrency = 1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.443924 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] image_cache.remove_unused_base_images = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.444577 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.445144 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.445746 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] image_cache.subdirectory_name = _base {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.446399 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.api_max_retries = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.448778 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.api_retry_interval = 2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.448778 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.auth_section = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.448778 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.auth_type = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.448778 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.448778 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.449495 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.450076 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.connect_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.450652 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.connect_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.451212 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.endpoint_override = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.451835 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.452424 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.454166 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.max_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.455283 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.min_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.455930 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.partition_key = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.456377 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.peer_list = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.456770 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.region_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.457166 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.serial_console_state_timeout = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.457553 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.service_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.459192 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.service_type = baremetal {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.459671 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.460142 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.status_code_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.461110 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.status_code_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.461510 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.461938 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.462336 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ironic.version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.462804 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.463410 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] key_manager.fixed_key = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.463891 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.464278 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.barbican_api_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.464699 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.barbican_endpoint = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.465128 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.barbican_endpoint_type = public {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.465518 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.465927 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.466329 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.466917 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.467307 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.467716 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.number_of_retries = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.468106 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.retry_delay = 1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.468530 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.468918 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.469378 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.verify_ssl = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.469750 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] barbican.verify_ssl_path = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.470163 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.approle_role_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.470710 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.approle_secret_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.471241 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.471784 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.472317 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.472869 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.473968 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.475042 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.kv_mountpoint = secret {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.475572 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.kv_version = 2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.476107 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.root_token_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.476706 chdv-799894-1 nova-conductor[82011]: DEBUG nova.service [None req-b0ac0549-ad09-475f-860e-0f18594c850f None None] Creating RPC server for service conductor {{(pid=82011) start /opt/stack/nova/nova/service.py:182}} Jul 08 08:02:38.476955 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.477510 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.ssl_ca_crt_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.478056 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.478592 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.use_ssl = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.479156 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.479744 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.480412 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.480962 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.481492 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.connect_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.482028 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.connect_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.482556 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.endpoint_override = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.483103 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.483628 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.484154 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.max_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.484736 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.min_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.487129 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.region_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.487731 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.service_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.488403 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.service_type = identity {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.489017 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.490226 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.status_code_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.490804 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.status_code_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.491372 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.491997 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.494043 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] keystone.version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.494886 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.connection_uri = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.496944 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.cpu_mode = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.497548 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.cpu_model_extra_flags = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.498227 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.cpu_models = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.498816 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.disk_cachemodes = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.499400 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.disk_prefix = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.499999 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.enabled_perf_events = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.500654 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.file_backed_memory = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.501235 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.gid_maps = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.501858 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.hw_disk_discard = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.502426 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.hw_machine_type = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.503023 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.images_rbd_ceph_conf = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.503605 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.506793 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.509764 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.images_rbd_glance_store_name = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.511637 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.images_rbd_pool = rbd {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.512993 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.images_type = default {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.513161 chdv-799894-1 nova-conductor[82010]: DEBUG nova.service [None req-95aa56e4-a44a-4029-8837-11486f6443e5 None None] Join ServiceGroup membership for this service conductor {{(pid=82010) start /opt/stack/nova/nova/service.py:199}} Jul 08 08:02:38.513642 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.images_volume_group = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.513967 chdv-799894-1 nova-conductor[82010]: DEBUG nova.servicegroup.drivers.db [None req-95aa56e4-a44a-4029-8837-11486f6443e5 None None] DB_Driver: join new ServiceGroup member chdv-799894-1 to the conductor group, service = {{(pid=82010) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Jul 08 08:02:38.514438 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.inject_key = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.515994 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.inject_partition = -2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.516639 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.inject_password = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.517231 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.iscsi_iface = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.517821 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.iser_use_multipath = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.518404 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_bandwidth = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.518996 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.519582 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_downtime = 500 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.520708 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.521754 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.522379 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_inbound_addr = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.522957 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.523531 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_permit_post_copy = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.524693 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_scheme = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.525123 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_timeout_action = abort {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.525523 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_tunnelled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.526090 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_uri = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.526490 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.live_migration_with_native_tls = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.526904 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.max_queues = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.527299 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.527705 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.nfs_mount_options = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.528243 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.528741 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.529129 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.num_iser_scan_tries = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.529512 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.num_memory_encrypted_guests = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.529934 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.530329 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.num_pcie_ports = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.530728 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.num_volume_scan_tries = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.531124 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.pmem_namespaces = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.531506 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.quobyte_client_cfg = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.531993 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.532517 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rbd_connect_timeout = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.533219 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.533638 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.534022 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rbd_secret_uuid = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.534510 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rbd_user = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.534908 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.535320 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.remote_filesystem_transport = ssh {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.535727 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rescue_image_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.537251 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rescue_kernel_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.537651 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rescue_ramdisk_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.538056 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.538447 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.rx_queue_size = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.538852 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.smbfs_mount_options = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.539386 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.539821 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.snapshot_compression = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.540254 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.snapshot_image_format = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.541401 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.542015 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.sparse_logical_volumes = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.543290 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.swtpm_enabled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.543714 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.swtpm_group = tss {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.544127 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.swtpm_user = tss {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.544588 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.sysinfo_serial = unique {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.545285 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.tx_queue_size = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.545692 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.uid_maps = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.549574 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.use_usb_tablet = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.552360 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.use_virtio_for_bridges = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.552832 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.virt_type = kvm {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.553303 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.volume_clear = zero {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.553723 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.volume_clear_size = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.554159 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.volume_use_multipath = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.554591 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.vzstorage_cache_path = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.555010 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.555447 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.vzstorage_mount_group = qemu {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.555854 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.vzstorage_mount_opts = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.556287 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.558173 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.559139 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.vzstorage_mount_user = stack {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.559594 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.559892 chdv-799894-1 nova-conductor[82011]: DEBUG nova.service [None req-b0ac0549-ad09-475f-860e-0f18594c850f None None] Join ServiceGroup membership for this service conductor {{(pid=82011) start /opt/stack/nova/nova/service.py:199}} Jul 08 08:02:38.560038 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.560640 chdv-799894-1 nova-conductor[82011]: DEBUG nova.servicegroup.drivers.db [None req-b0ac0549-ad09-475f-860e-0f18594c850f None None] DB_Driver: join new ServiceGroup member chdv-799894-1 to the conductor group, service = {{(pid=82011) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Jul 08 08:02:38.560844 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.auth_section = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.562485 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.auth_type = password {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.563121 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.563558 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.563986 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.564432 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.connect_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.564927 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.connect_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.565373 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.default_floating_pool = public {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.565793 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.endpoint_override = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.566218 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.extension_sync_interval = 600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.566622 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.http_retries = 3 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.567075 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.568101 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.568618 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.max_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.569062 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.569618 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.min_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.570192 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.ovs_bridge = br-int {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.570677 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.physnets = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.571089 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.region_name = RegionOne {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.571493 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.service_metadata_proxy = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.571878 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.service_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.572284 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.service_type = network {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.572703 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.573087 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.status_code_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.573471 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.status_code_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.573857 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.574289 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.574661 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] neutron.version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.575058 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] notifications.bdms_in_notifications = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.575481 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] notifications.default_level = INFO {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.575881 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] notifications.notification_format = unversioned {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.576457 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] notifications.notify_on_state_change = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.576921 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.577336 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] pci.alias = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.577730 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] pci.passthrough_whitelist = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.578158 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.auth_section = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.578560 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.auth_type = password {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.578980 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.auth_url = http://10.222.0.50/identity {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.579363 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.579747 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.580131 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.580558 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.connect_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.580946 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.connect_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.581360 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.default_domain_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.581750 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.default_domain_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.582401 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.domain_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.584179 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.domain_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.584595 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.endpoint_override = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.584987 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.585380 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.585761 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.max_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.586152 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.min_version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.586549 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.password = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.586940 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.project_domain_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.587344 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.project_domain_name = Default {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.587734 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.project_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.588159 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.project_name = service {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.588582 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.region_name = RegionOne {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.588964 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.service_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.589363 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.service_type = placement {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.589745 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.590129 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.status_code_retries = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.590508 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.status_code_retry_delay = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.590896 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.system_scope = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.591277 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.591655 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.trust_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.592037 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.user_domain_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.592515 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.user_domain_name = Default {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.592923 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.user_id = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.593331 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.username = placement {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.593748 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.594123 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] placement.version = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.594548 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] powervm.disk_driver = localdisk {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.594944 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] powervm.proc_units_factor = 0.1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.595336 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] powervm.volume_group_name = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.595759 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.cores = 20 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.596140 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.count_usage_from_placement = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.596565 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.596991 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.injected_file_content_bytes = 10240 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.597386 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.injected_file_path_length = 255 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.597778 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.injected_files = 5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.598166 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.instances = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.599580 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.key_pairs = 100 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.600006 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.metadata_items = 128 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.600434 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.ram = 51200 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.600826 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.recheck_quota = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.601224 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.server_group_members = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.601618 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] quota.server_groups = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.602026 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] rdp.enabled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.602696 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.603138 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.603549 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.driver = filter_scheduler {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.603961 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.604369 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.image_metadata_prefilter = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.604814 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.605217 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.max_attempts = 3 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.605602 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.max_placement_results = 1000 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.605987 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.periodic_task_interval = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.606370 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.606755 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.query_placement_for_availability_zone = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.607142 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.query_placement_for_image_type_support = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.607543 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] scheduler.workers = 2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.607977 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.608424 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.608868 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.609283 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.609671 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.610061 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.610451 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.610996 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.611391 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.host_subset_size = 1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.611777 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.612168 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.612591 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.isolated_hosts = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.612982 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.isolated_images = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.613369 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.613758 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.614714 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.615115 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.615513 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.615901 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.616291 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.616707 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.617117 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.track_instance_changes = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.617543 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.617941 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] metrics.required = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.618331 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] metrics.weight_multiplier = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.618711 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.619094 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] metrics.weight_setting = [] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.619684 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.620069 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] serial_console.enabled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.620520 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] serial_console.port_range = 10000:20000 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.620929 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.621326 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.621718 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] serial_console.serialproxy_port = 6083 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.622108 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.auth_section = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.622499 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.auth_type = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.622876 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.623250 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.623846 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.624226 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.624723 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.625108 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.send_service_user_token = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.625496 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.625878 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] service_user.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.626309 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] spice.agent_enabled = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.626696 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] spice.enabled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.627306 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.627790 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.628178 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] spice.html5proxy_port = 6082 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.628697 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] spice.server_listen = 127.0.0.1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.629010 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.630128 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] upgrade_levels.baseapi = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.630903 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] upgrade_levels.cert = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.631255 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] upgrade_levels.compute = auto {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.631640 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] upgrade_levels.conductor = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.632309 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] upgrade_levels.scheduler = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.637497 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vendordata_dynamic_auth.auth_section = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.637497 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vendordata_dynamic_auth.auth_type = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.637497 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vendordata_dynamic_auth.cafile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.637497 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vendordata_dynamic_auth.certfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.637497 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.637497 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vendordata_dynamic_auth.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.637497 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vendordata_dynamic_auth.keyfile = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.638527 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.638527 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vendordata_dynamic_auth.timeout = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.638527 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.api_retry_count = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.638527 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.ca_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.638527 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.cache_prefix = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.638527 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.cluster_name = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.638527 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.connection_pool_size = 10 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.639582 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.console_delay_seconds = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.639582 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.datastore_regex = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.639582 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.host_ip = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.639582 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.host_password = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.640127 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.host_port = 443 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.640127 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.host_username = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.640629 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.insecure = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.640819 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.integration_bridge = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.641208 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.maximum_objects = 100 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.641583 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.pbm_default_policy = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.641968 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.pbm_enabled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.642344 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.pbm_wsdl_location = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.642737 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.643134 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.serial_port_proxy_uri = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.643510 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.serial_port_service_uri = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.643903 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.task_poll_interval = 0.5 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.644296 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.use_linked_clone = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.644712 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.vnc_keymap = en-us {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.645097 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.vnc_port = 5900 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.649202 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vmware.vnc_port_total = 10000 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.649202 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.auth_schemes = ['none'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.649202 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.enabled = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.649202 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.649202 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.649202 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.novncproxy_port = 6080 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.650075 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.server_listen = 127.0.0.1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.650075 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.650075 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.vencrypt_ca_certs = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.650690 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.vencrypt_client_cert = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.650690 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] vnc.vencrypt_client_key = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.651111 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.651493 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.651873 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.652252 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.disable_native_luksv1 = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.652657 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.disable_rootwrap = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.653437 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.enable_numa_live_migration = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.653437 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.653792 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.654229 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.654639 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.rbd_volume_local_attach = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.654992 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.655414 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.659289 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.client_socket_timeout = 900 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.659289 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.default_pool_size = 1000 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.659289 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.keep_alive = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.659289 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.max_header_line = 16384 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.659289 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.secure_proxy_ssl_header = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.660557 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.ssl_ca_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.660557 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.ssl_cert_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.660557 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.ssl_key_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.660557 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.tcp_keepidle = 600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.664241 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.664241 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] zvm.ca_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.664241 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] zvm.cloud_connector_url = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.664912 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.665172 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] zvm.reachable_timeout = 300 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.665637 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.enforce_new_defaults = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.666035 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.enforce_scope = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.666451 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.policy_default_rule = default {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.666901 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.667363 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.policy_file = policy.yaml {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.667757 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.668147 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.668565 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.668951 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.672088 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.672088 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.672088 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.connection_string = messaging:// {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.672088 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.enabled = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.672088 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.es_doc_type = notification {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.672088 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.es_scroll_size = 10000 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.672560 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.es_scroll_time = 2m {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.672560 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.filter_error_trace = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.672560 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.hmac_keys = SECRET_KEY {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.673019 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.sentinel_service_name = mymaster {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.673342 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.socket_timeout = 0.1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.673727 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] profiler.trace_sqlalchemy = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.674156 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] remote_debug.host = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.674541 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] remote_debug.port = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.674968 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.675355 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.675746 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.676128 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.676690 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.677624 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.678028 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.678433 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.678836 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.679223 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.679629 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.680027 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.680466 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.680866 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.681651 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.682070 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.682461 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.683112 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.683500 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.684134 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.684567 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.684993 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.ssl = False {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.685402 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.685824 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.686235 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.686660 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.687115 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.687502 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_notifications.retry = -1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.687925 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.688366 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.688799 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_reports.file_event_handler = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.689205 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.689614 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] oslo_reports.log_dir = None {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Jul 08 08:02:38.689934 chdv-799894-1 nova-conductor[81125]: DEBUG oslo_service.service [None req-0f1e4516-fecb-4445-a072-1f4041289a72 None None] ******************************************************************************** {{(pid=81125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 08 08:05:38.465694 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:05:38.546180 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:05:39.488087 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45464. Jul 08 08:05:39.568734 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45466. Jul 08 08:08:39.483277 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:08:39.564184 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:08:40.503686 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45526. Jul 08 08:08:40.584914 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45528. Jul 08 08:11:40.501594 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:11:40.582312 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:11:41.525018 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45648. Jul 08 08:11:41.606138 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45650. Jul 08 08:12:11.284012 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_db.sqlalchemy.engines [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Parent process 81125 forked (82010) with an open database connection, which is being discarded and recreated. {{(pid=82010) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Jul 08 08:12:12.997685 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Took 1.70 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:12:13.071328 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:13.075453 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:13.096178 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_db.sqlalchemy.engines [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jul 08 08:12:13.446999 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:13.449040 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:13.449779 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:13.450170 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:13.471661 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_db.sqlalchemy.engines [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jul 08 08:12:13.490177 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Getting quotas for project bcd050e008ee4bee91bc04241cd14ee2. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:12:13.495204 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Getting quotas for user 27cce9f7688e459a97d08dd4b24d27ec and project bcd050e008ee4bee91bc04241cd14ee2. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:12:13.506137 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] [instance: 6386102c-20eb-42b9-b227-ab104803762e] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:12:13.507198 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:13.507753 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:13.591495 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] [instance: 6386102c-20eb-42b9-b227-ab104803762e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:12:13.594313 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:13.594909 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:13.861871 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:13.862276 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:13.863005 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3a7e03eb-5507-4bbd-95c0-f610b827106b tempest-AggregatesAdminTestJSON-329198636 tempest-AggregatesAdminTestJSON-329198636-project] Acquired lock "compute-rpcapi-router" {{(pid=82010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 08 08:12:13.864107 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d329d5-7987-48f5-89e0-f07e2fd83164 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:13.864542 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d329d5-7987-48f5-89e0-f07e2fd83164 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:13.865810 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d329d5-7987-48f5-89e0-f07e2fd83164 None None] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:13.866373 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d329d5-7987-48f5-89e0-f07e2fd83164 None None] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:13.883822 chdv-799894-1 nova-conductor[82010]: INFO nova.compute.rpcapi [None req-e8d329d5-7987-48f5-89e0-f07e2fd83164 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Jul 08 08:12:13.885036 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d329d5-7987-48f5-89e0-f07e2fd83164 None None] Releasing lock "compute-rpcapi-router" {{(pid=82010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 08 08:12:14.822008 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_db.sqlalchemy.engines [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Parent process 81125 forked (82011) with an open database connection, which is being discarded and recreated. {{(pid=82011) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Jul 08 08:12:15.726518 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:12:15.814850 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:15.819567 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:15.867132 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_db.sqlalchemy.engines [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jul 08 08:12:16.225395 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:16.227209 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:16.228090 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:16.228695 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:16.274494 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_db.sqlalchemy.engines [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jul 08 08:12:16.305843 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Getting quotas for project 567f61efb68f4121b1ebb70eed3ad9a5. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:12:16.320466 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Getting quotas for user 9658362b1fd64c9b9289a547fa59ec72 and project 567f61efb68f4121b1ebb70eed3ad9a5. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:12:16.347166 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] [instance: 66b06daa-0015-45ed-9df1-7e98d94b69cb] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:12:16.348670 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:16.349271 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:16.444523 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] [instance: 66b06daa-0015-45ed-9df1-7e98d94b69cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:12:16.447935 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:16.448613 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:16.764153 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:16.768796 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:16.769971 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-df361e5b-4751-4a13-9366-bf1877df56d9 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Acquired lock "compute-rpcapi-router" {{(pid=82011) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 08 08:12:16.773379 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-11294a3a-0bda-4612-8c14-0755b3b03f3d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:16.773805 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-11294a3a-0bda-4612-8c14-0755b3b03f3d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:16.776231 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-11294a3a-0bda-4612-8c14-0755b3b03f3d None None] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:16.776689 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-11294a3a-0bda-4612-8c14-0755b3b03f3d None None] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:16.803213 chdv-799894-1 nova-conductor[82011]: INFO nova.compute.rpcapi [None req-11294a3a-0bda-4612-8c14-0755b3b03f3d None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Jul 08 08:12:16.807561 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-11294a3a-0bda-4612-8c14-0755b3b03f3d None None] Releasing lock "compute-rpcapi-router" {{(pid=82011) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 08 08:12:56.170800 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:12:56.193326 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:56.193736 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:56.383927 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:56.385714 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:56.387703 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:56.389679 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:56.452983 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Getting quotas for project b3701114970945cf9c61a6aef69997dc. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:12:56.460946 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Getting quotas for user a6a589ade7e6400e8773f71f1f561174 and project b3701114970945cf9c61a6aef69997dc. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:12:56.481403 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] [instance: 1142f22c-5f34-4fa8-8f3c-aadd63ffa31d] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:12:56.487315 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:56.487826 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:56.580832 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] [instance: 1142f22c-5f34-4fa8-8f3c-aadd63ffa31d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:12:56.582613 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:56.583250 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:56.852097 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:56.853016 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57c90a02-1d2e-4018-ad6b-0b030a8f33ce tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:57.919166 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:12:57.977829 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:57.978197 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:58.244416 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:58.246576 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:58.249264 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:58.255013 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:58.315896 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Getting quotas for project ae3d48c570204ec1871aa553689de9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:12:58.329041 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Getting quotas for user 0c4c42376cbd4b66b2f335630512057a and project ae3d48c570204ec1871aa553689de9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:12:58.350584 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] [instance: c856d93d-f9bf-4d32-8410-f6792708c46c] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:12:58.352056 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:58.352823 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:58.415200 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] [instance: c856d93d-f9bf-4d32-8410-f6792708c46c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:12:58.416729 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:58.418149 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:12:58.664677 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:12:58.665387 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-860261af-5bfc-4077-8b2f-55c70e679560 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:05.131430 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:13:05.194797 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:05.195213 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:05.381927 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:05.384364 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:05.386418 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:05.388700 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:05.426397 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Getting quotas for project 567f61efb68f4121b1ebb70eed3ad9a5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:13:05.448832 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Getting quotas for user 9658362b1fd64c9b9289a547fa59ec72 and project 567f61efb68f4121b1ebb70eed3ad9a5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:13:05.476887 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] [instance: 871154d7-be03-4a90-88ef-73137a5d8efc] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:13:05.478180 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:05.478700 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:05.557501 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] [instance: 871154d7-be03-4a90-88ef-73137a5d8efc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:13:05.559002 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:05.559584 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:05.825968 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:05.826442 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd2dccb4-4085-4976-ae6e-2b090d6651f0 tempest-DeleteServersAdminTestJSON-1395689279 tempest-DeleteServersAdminTestJSON-1395689279-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:11.770248 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:13:11.810899 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:11.811304 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:12.033983 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:12.036893 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:12.037705 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:12.038261 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:12.056648 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Getting quotas for project 12391eccb2cc45b2b12ff187d105e49a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:13:12.060355 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Getting quotas for user 360315ee32ce4d7abf6923f8b8a0f738 and project 12391eccb2cc45b2b12ff187d105e49a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:13:12.071576 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] [instance: ad80a21a-4096-4a81-84c1-18d4a39c6bff] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:13:12.072591 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:12.073318 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:12.219864 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] [instance: ad80a21a-4096-4a81-84c1-18d4a39c6bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:13:12.224192 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:12.224192 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:12.618385 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:12.625667 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-87cbeef3-d775-4f77-9467-aabbb0728eb7 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:13.002104 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:13:13.039355 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:13.039759 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:13.192925 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:13.193660 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:13.194784 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:13.195685 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:13.221151 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Getting quotas for project 12391eccb2cc45b2b12ff187d105e49a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:13:13.226253 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Getting quotas for user 360315ee32ce4d7abf6923f8b8a0f738 and project 12391eccb2cc45b2b12ff187d105e49a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:13:13.238708 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] [instance: 3f67a025-2cf0-4d63-8a75-8e456e61205f] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:13:13.239846 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:13.240456 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:13.311346 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] [instance: 3f67a025-2cf0-4d63-8a75-8e456e61205f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:13:13.315021 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:13.315021 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:13.573917 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:13.574720 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8c6482d3-c5d3-42e9-ba96-34d06da24a4b tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:23.567720 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:13:23.612527 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:23.613151 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:23.905816 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:23.912100 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:23.912100 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:23.912100 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:23.958877 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Getting quotas for project aea3a472d6514700ae904115f1beda3d. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:13:23.966821 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Getting quotas for user 7d9739796b42421db058e698f3e262f6 and project aea3a472d6514700ae904115f1beda3d. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:13:23.995363 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] [instance: 757ef78c-67e8-47bf-aab7-3bca280b9f44] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:13:23.997595 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:23.998556 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:24.071604 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] [instance: 757ef78c-67e8-47bf-aab7-3bca280b9f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:13:24.074308 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:24.075230 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:24.347058 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:24.348952 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-815a1a59-0a13-4851-b00a-65ed5944c1d7 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:27.882742 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-fcdcd14a-3cf1-4d0a-b456-390ffb9ad1a5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:13:27.883299 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fcdcd14a-3cf1-4d0a-b456-390ffb9ad1a5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:27.883633 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fcdcd14a-3cf1-4d0a-b456-390ffb9ad1a5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:29.536366 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-fcdcd14a-3cf1-4d0a-b456-390ffb9ad1a5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Created allocations for migration 31f51880-28e9-41f3-b6fa-c7f854c7b631 on 16a62ade-abe7-4fff-b6af-b1d7b02e694d {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:13:30.160685 chdv-799894-1 nova-conductor[82010]: DEBUG nova.scheduler.utils [None req-fcdcd14a-3cf1-4d0a-b456-390ffb9ad1a5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] [instance: c856d93d-f9bf-4d32-8410-f6792708c46c] Instance allocations successfully created on destination node 97482c17-d206-4c76-b496-62a0dc51a4e3: {'allocations': {'97482c17-d206-4c76-b496-62a0dc51a4e3': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=82010) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Jul 08 08:13:30.160685 chdv-799894-1 nova-conductor[82010]: DEBUG nova.objects.instance [None req-fcdcd14a-3cf1-4d0a-b456-390ffb9ad1a5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lazy-loading 'resources' on Instance uuid c856d93d-f9bf-4d32-8410-f6792708c46c {{(pid=82010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:13:30.165911 chdv-799894-1 nova-conductor[82010]: DEBUG nova.objects.instance [None req-fcdcd14a-3cf1-4d0a-b456-390ffb9ad1a5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lazy-loading 'pci_requests' on Instance uuid c856d93d-f9bf-4d32-8410-f6792708c46c {{(pid=82010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:13:30.794704 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.live_migrate [None req-fcdcd14a-3cf1-4d0a-b456-390ffb9ad1a5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] [instance: c856d93d-f9bf-4d32-8410-f6792708c46c] Start binding ports on destination host: chh1-799894-1 {{(pid=82010) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Jul 08 08:13:38.567229 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:13:38.608261 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:38.608752 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:38.893590 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:38.894329 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:38.895330 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:38.896135 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:38.926105 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Getting quotas for project a9c559ac20224d63893b45e07f47bcf3. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:13:38.930280 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Getting quotas for user c7418d437a4e4a40a301ff1d6040a7bc and project a9c559ac20224d63893b45e07f47bcf3. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:13:38.953144 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] [instance: 59548297-e977-4e26-abc8-81057570aa6a] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:13:38.955066 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:38.955991 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:39.064894 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] [instance: 59548297-e977-4e26-abc8-81057570aa6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:13:39.067215 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:39.067834 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:39.361188 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:13:39.373695 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:39.374383 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae96e5f3-5ff5-4318-a82d-66b9c82e5fca tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:39.384427 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:39.385096 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:39.569791 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:39.570297 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:39.571034 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:39.572553 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:39.610717 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Getting quotas for project 12391eccb2cc45b2b12ff187d105e49a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:13:39.614780 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Getting quotas for user 360315ee32ce4d7abf6923f8b8a0f738 and project 12391eccb2cc45b2b12ff187d105e49a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:13:39.627065 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] [instance: 77672237-50e8-46fe-b805-048bbdaa8f5d] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:13:39.628293 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:39.628985 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:39.698647 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] [instance: 77672237-50e8-46fe-b805-048bbdaa8f5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:13:39.700108 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:39.700952 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:40.004767 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:40.005735 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-aabef3f4-4f50-47d5-bbea-03575ece690f tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:48.171404 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:13:48.201728 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:48.202496 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:48.314529 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:48.315142 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:48.316035 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:48.316616 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:48.333316 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Getting quotas for project aea3a472d6514700ae904115f1beda3d. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:13:48.336929 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Getting quotas for user 7d9739796b42421db058e698f3e262f6 and project aea3a472d6514700ae904115f1beda3d. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:13:48.346601 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] [instance: 7d70f26e-db46-42eb-a205-bba92d9bf4fd] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:13:48.347513 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:48.347906 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:48.441069 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] [instance: 7d70f26e-db46-42eb-a205-bba92d9bf4fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:13:48.442540 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:48.443160 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:48.715438 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:48.715835 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddf3eb69-13aa-4363-a0cd-8360c9d5ff70 tempest-FloatingIPsAssociationTestJSON-914582267 tempest-FloatingIPsAssociationTestJSON-914582267-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:52.433057 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:13:52.467186 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:52.467786 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:52.658635 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:52.659419 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:52.660821 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:52.661984 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:52.681577 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Getting quotas for project ae3d48c570204ec1871aa553689de9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:13:52.685797 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Getting quotas for user 0c4c42376cbd4b66b2f335630512057a and project ae3d48c570204ec1871aa553689de9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:13:52.697174 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] [instance: f5751f58-1ba8-4275-981a-64ea57653659] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:13:52.698320 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:52.698925 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:52.768150 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] [instance: f5751f58-1ba8-4275-981a-64ea57653659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:13:52.769919 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:52.770572 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:13:53.029630 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:13:53.030246 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e3862d6-74fe-4c00-867d-37d1ba22c36d tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:00.678903 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:14:00.728331 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:00.730306 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:00.841069 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:00.841473 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:00.842176 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:00.842555 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:00.863948 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Getting quotas for project a9c559ac20224d63893b45e07f47bcf3. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:14:00.869172 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Getting quotas for user c7418d437a4e4a40a301ff1d6040a7bc and project a9c559ac20224d63893b45e07f47bcf3. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:14:00.883529 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] [instance: 180029f0-b7a7-4f25-a35e-1259d40b4f60] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:14:00.885197 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:00.885748 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:00.949292 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] [instance: 180029f0-b7a7-4f25-a35e-1259d40b4f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:14:00.953006 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:00.953006 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:01.218260 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:01.218662 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2997ca5b-fa8b-4d45-84a0-1eaf9f6f7de0 tempest-LiveMigrationNegativeTest-308758747 tempest-LiveMigrationNegativeTest-308758747-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:15.106768 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:14:15.142425 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:15.143129 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:15.338111 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:15.338512 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:15.339225 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:15.339607 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:15.356951 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Getting quotas for project 18b1ac03b3d04b62a58d48c6cf118726. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:14:15.361683 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Getting quotas for user 6cf1aaab99ab4abfa7a5f2a4c041b87d and project 18b1ac03b3d04b62a58d48c6cf118726. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:14:15.372934 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: fdcf755c-73b1-4e21-8d0c-61db64ee0d01] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:14:15.374315 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:15.374849 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:15.440487 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: fdcf755c-73b1-4e21-8d0c-61db64ee0d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:14:15.449335 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:15.449335 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:15.477065 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-30147394-7c7c-4126-b679-e9a90a896de6 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method rebuild_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:14:15.483361 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-30147394-7c7c-4126-b679-e9a90a896de6 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:15.483361 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-30147394-7c7c-4126-b679-e9a90a896de6 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:15.579921 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-30147394-7c7c-4126-b679-e9a90a896de6 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] [instance: ad80a21a-4096-4a81-84c1-18d4a39c6bff] No migration record for the rebuild/evacuate request. {{(pid=82011) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Jul 08 08:14:15.703447 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:15.703855 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5030f80f-87cf-443b-bc04-f28ce6d1f6f5 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:17.919392 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e82c5977-7c8c-4922-b1c6-5eeb113a2141 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:14:17.922444 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e82c5977-7c8c-4922-b1c6-5eeb113a2141 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:17.923009 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e82c5977-7c8c-4922-b1c6-5eeb113a2141 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:18.716826 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-e82c5977-7c8c-4922-b1c6-5eeb113a2141 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Created allocations for migration 164cecc8-7730-4fae-a20b-5c07f1f80da7 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:14:18.982097 chdv-799894-1 nova-conductor[82010]: DEBUG nova.scheduler.utils [None req-e82c5977-7c8c-4922-b1c6-5eeb113a2141 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] [instance: f5751f58-1ba8-4275-981a-64ea57653659] Instance allocations successfully created on destination node 16a62ade-abe7-4fff-b6af-b1d7b02e694d: {'allocations': {'16a62ade-abe7-4fff-b6af-b1d7b02e694d': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=82010) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Jul 08 08:14:18.988105 chdv-799894-1 nova-conductor[82010]: DEBUG nova.objects.instance [None req-e82c5977-7c8c-4922-b1c6-5eeb113a2141 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lazy-loading 'resources' on Instance uuid f5751f58-1ba8-4275-981a-64ea57653659 {{(pid=82010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:14:18.989541 chdv-799894-1 nova-conductor[82010]: DEBUG nova.objects.instance [None req-e82c5977-7c8c-4922-b1c6-5eeb113a2141 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lazy-loading 'pci_requests' on Instance uuid f5751f58-1ba8-4275-981a-64ea57653659 {{(pid=82010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:14:19.582603 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.live_migrate [None req-e82c5977-7c8c-4922-b1c6-5eeb113a2141 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] [instance: f5751f58-1ba8-4275-981a-64ea57653659] Start binding ports on destination host: chh2-799894-1 {{(pid=82010) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Jul 08 08:14:34.561790 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:14:34.613102 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:34.613602 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:34.814697 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:34.815105 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:34.815828 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:34.816220 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:34.858419 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Getting quotas for project d361c9441a0b4a95b86caebd658a3c54. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:14:34.865632 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Getting quotas for user 70999d3ec1e94995afdcc9f60e02e990 and project d361c9441a0b4a95b86caebd658a3c54. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:14:34.892119 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] [instance: 1c48d66e-26ec-43cb-bcd0-0c1a57b81c22] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:14:34.896446 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:34.897014 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:34.994172 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] [instance: 1c48d66e-26ec-43cb-bcd0-0c1a57b81c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:14:34.995407 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:34.996014 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:35.291208 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:35.291878 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99357a34-1f53-49a3-85de-806e0a72e473 tempest-ImagesNegativeTestJSON-1697757700 tempest-ImagesNegativeTestJSON-1697757700-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:37.086478 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e90035ef-8127-4e3d-8587-f515deb58351 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method rebuild_instance {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:14:37.087035 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e90035ef-8127-4e3d-8587-f515deb58351 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:37.087710 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e90035ef-8127-4e3d-8587-f515deb58351 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:37.208889 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e90035ef-8127-4e3d-8587-f515deb58351 tempest-ServersAdminTestJSON-1664174520 tempest-ServersAdminTestJSON-1664174520-project] [instance: ad80a21a-4096-4a81-84c1-18d4a39c6bff] No migration record for the rebuild/evacuate request. {{(pid=82010) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Jul 08 08:14:38.602233 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6ce73cf4-1b6f-440a-a8bd-0de57021142f tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:14:38.602732 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6ce73cf4-1b6f-440a-a8bd-0de57021142f tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:38.605553 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6ce73cf4-1b6f-440a-a8bd-0de57021142f tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:39.281408 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-6ce73cf4-1b6f-440a-a8bd-0de57021142f tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] [instance: fdcf755c-73b1-4e21-8d0c-61db64ee0d01] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82011) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 08:14:39.292614 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:14:39.322152 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:39.322568 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:39.463793 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:39.464389 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:39.465207 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:39.467483 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:39.499678 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Getting quotas for project ae3d48c570204ec1871aa553689de9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:14:39.508415 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Getting quotas for user 0c4c42376cbd4b66b2f335630512057a and project ae3d48c570204ec1871aa553689de9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:14:39.542394 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] [instance: 75156341-4b5b-416a-9e17-31afff42ac9f] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:14:39.543355 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:39.543765 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:39.617745 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] [instance: 75156341-4b5b-416a-9e17-31afff42ac9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:14:39.619577 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:39.620153 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:39.914380 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:14:39.914944 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-952f280a-5995-4c1e-b320-c463fc4dfe8f tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:14:40.020955 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-6ce73cf4-1b6f-440a-a8bd-0de57021142f tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] Created allocations for migration aec1fed1-d0c1-41d0-8ce9-3a2111be672c on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82011) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:14:40.603975 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-6ce73cf4-1b6f-440a-a8bd-0de57021142f tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] [instance: fdcf755c-73b1-4e21-8d0c-61db64ee0d01] Calling prep_resize with selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82011) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 08:15:00.431368 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:15:00.473297 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:00.473689 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:00.685701 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:00.686650 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:00.688870 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:00.690140 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:00.728839 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Getting quotas for project b3701114970945cf9c61a6aef69997dc. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:15:00.736496 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Getting quotas for user a6a589ade7e6400e8773f71f1f561174 and project b3701114970945cf9c61a6aef69997dc. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:15:00.758827 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] [instance: 75a64668-123c-40e2-92da-e8ec9e34ed83] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:15:00.760155 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:00.761875 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:00.833694 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] [instance: 75a64668-123c-40e2-92da-e8ec9e34ed83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:15:00.836582 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:00.836582 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:00.954220 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:00.954630 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:01.250576 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:01.250982 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dbb3e4a1-adfc-4661-add8-4db76d4ffb18 tempest-ServersWithSpecificFlavorTestJSON-1360865316 tempest-ServersWithSpecificFlavorTestJSON-1360865316-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:14.242738 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Took 0.96 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:15:14.307083 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:14.307499 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:14.586261 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:14.587092 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:14.587823 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:14.588222 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:14.641542 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Getting quotas for project 7c2d3cdcf4324314be04d7b34ce0c250. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:15:14.649487 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Getting quotas for user 48b1dd05d0424ab0991982f9dd5b3250 and project 7c2d3cdcf4324314be04d7b34ce0c250. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:15:14.667661 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] [instance: f0c50c19-b973-4ff0-80fc-bf661037079d] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:15:14.669056 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:14.669639 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:14.781926 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] [instance: f0c50c19-b973-4ff0-80fc-bf661037079d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:15:14.783261 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:14.783671 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:15.063741 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:15.064427 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-50a7c37c-5b67-49a5-9085-46c4013d3b38 tempest-InstanceActionsTestJSON-416133680 tempest-InstanceActionsTestJSON-416133680-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:16.901326 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:15:16.926756 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:16.927406 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:17.220316 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:17.221855 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:17.225668 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:17.226607 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:17.274829 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Getting quotas for project bc58c66f746b45039e678f6407901e0d. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:15:17.285807 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Getting quotas for user 007cfa5d2e324a859c934f98acd9df49 and project bc58c66f746b45039e678f6407901e0d. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:15:17.318635 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] [instance: d8154d4b-a3c2-4183-8f8a-833985fb35f6] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:15:17.323221 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:17.324746 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:17.422514 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] [instance: d8154d4b-a3c2-4183-8f8a-833985fb35f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:15:17.425281 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:17.425729 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:17.753135 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:17.753594 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e0a17e39-0ffb-4ad4-a6a8-095f1753b397 tempest-InstanceActionsV221TestJSON-531434845 tempest-InstanceActionsV221TestJSON-531434845-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:25.509572 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-739083ca-b6a9-4158-87dd-81633d95df0e tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:15:25.510076 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-739083ca-b6a9-4158-87dd-81633d95df0e tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:25.510436 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-739083ca-b6a9-4158-87dd-81633d95df0e tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:26.488284 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-739083ca-b6a9-4158-87dd-81633d95df0e tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Created allocations for migration 94a0f83c-5dd7-47d4-b21f-468aceb5ec99 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:15:26.767745 chdv-799894-1 nova-conductor[82010]: DEBUG nova.scheduler.utils [None req-739083ca-b6a9-4158-87dd-81633d95df0e tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] [instance: 75156341-4b5b-416a-9e17-31afff42ac9f] Instance allocations successfully created on destination node 16a62ade-abe7-4fff-b6af-b1d7b02e694d: {'allocations': {'16a62ade-abe7-4fff-b6af-b1d7b02e694d': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=82010) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Jul 08 08:15:26.768323 chdv-799894-1 nova-conductor[82010]: DEBUG nova.objects.instance [None req-739083ca-b6a9-4158-87dd-81633d95df0e tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lazy-loading 'resources' on Instance uuid 75156341-4b5b-416a-9e17-31afff42ac9f {{(pid=82010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:15:26.773116 chdv-799894-1 nova-conductor[82010]: DEBUG nova.objects.instance [None req-739083ca-b6a9-4158-87dd-81633d95df0e tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lazy-loading 'pci_requests' on Instance uuid 75156341-4b5b-416a-9e17-31afff42ac9f {{(pid=82010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:15:27.521805 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.live_migrate [None req-739083ca-b6a9-4158-87dd-81633d95df0e tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] [instance: 75156341-4b5b-416a-9e17-31afff42ac9f] Start binding ports on destination host: chh2-799894-1 {{(pid=82010) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Jul 08 08:15:32.512943 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:15:32.548507 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:32.549203 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:32.816174 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:32.821376 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:32.822210 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:32.827830 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:32.865506 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Getting quotas for project c3c20ece2fd94e0aaedea3beae810e6d. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:15:32.873277 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Getting quotas for user 67f7936fcf554d658e020cb4eed6d59e and project c3c20ece2fd94e0aaedea3beae810e6d. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:15:32.895960 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] [instance: b463906a-e1c9-493e-954c-5fe954a9c853] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:15:32.895960 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:32.895960 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:32.990398 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] [instance: b463906a-e1c9-493e-954c-5fe954a9c853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:15:32.990398 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:32.990398 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:33.185654 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:15:33.237214 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:33.237214 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:33.301676 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:33.301990 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f1d19da6-c408-4738-b318-ef309615245a tempest-ServerDiagnosticsNegativeTest-1038666871 tempest-ServerDiagnosticsNegativeTest-1038666871-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:33.492383 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:33.495339 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:33.497004 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:33.498896 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:33.527462 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Getting quotas for project 18b1ac03b3d04b62a58d48c6cf118726. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:15:33.533480 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Getting quotas for user 6cf1aaab99ab4abfa7a5f2a4c041b87d and project 18b1ac03b3d04b62a58d48c6cf118726. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:15:33.554237 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 4263ca38-6a7d-473b-ba4f-f75523e5dfd0] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:15:33.558608 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:33.559490 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:33.655659 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 4263ca38-6a7d-473b-ba4f-f75523e5dfd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:15:33.656999 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:33.657470 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:34.058148 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:34.058148 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-14877f0b-473c-4ebe-8c41-b7c9f66e6733 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:57.158251 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:15:57.187412 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:57.188152 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:57.479347 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:57.480210 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:57.481222 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:57.482528 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:57.507027 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Getting quotas for project c789de41530f4abbb5bbacc2745650aa. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:15:57.516936 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Getting quotas for user 0d57d63728804a4bb7ee737719510d3a and project c789de41530f4abbb5bbacc2745650aa. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:15:57.537166 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] [instance: 77beec5c-96be-4602-a558-c270a5e89490] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:15:57.538719 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:57.541471 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:57.695094 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] [instance: 77beec5c-96be-4602-a558-c270a5e89490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:15:57.704043 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:57.709986 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:58.262595 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:58.263232 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-98a487a8-4db0-463b-a528-3e109d48bbf0 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:59.133037 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:15:59.175299 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:59.176064 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:59.542017 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:59.542450 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:59.544172 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:59.545391 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:59.578237 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Getting quotas for project f406405909654b1cb3234fe62427dfad. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:15:59.581399 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Getting quotas for user ced895afeb664891bb93141e80fa5b52 and project f406405909654b1cb3234fe62427dfad. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:15:59.596114 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] [instance: 508cd5b2-cd28-40c0-adbe-76c5361a467d] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:15:59.598571 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:59.599060 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:59.711994 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] [instance: 508cd5b2-cd28-40c0-adbe-76c5361a467d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:15:59.714026 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:59.714598 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:15:59.930233 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ee8aec0b-051a-40a0-9a77-42e0d87e718d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:15:59.930795 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ee8aec0b-051a-40a0-9a77-42e0d87e718d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:15:59.944255 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ee8aec0b-051a-40a0-9a77-42e0d87e718d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:00.294270 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:00.300291 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a504ffba-c63b-4ed5-89da-c73af4a3427c tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:00.831648 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:16:00.882191 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:00.882865 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:01.113458 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-ee8aec0b-051a-40a0-9a77-42e0d87e718d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 4263ca38-6a7d-473b-ba4f-f75523e5dfd0] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82011) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 08:16:01.132859 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:01.136112 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:01.138302 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:01.142158 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:01.189186 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Getting quotas for project f406405909654b1cb3234fe62427dfad. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:16:01.200174 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Getting quotas for user ced895afeb664891bb93141e80fa5b52 and project f406405909654b1cb3234fe62427dfad. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:16:01.224163 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] [instance: 79c0d47b-2180-413a-9508-a1a41f1e1a76] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:01.225169 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:01.229890 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:01.340140 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] [instance: 79c0d47b-2180-413a-9508-a1a41f1e1a76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:01.342663 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:01.343358 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:01.740519 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:01.741520 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f2c1d58d-b939-4b25-9d40-702e8b891d25 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:02.293072 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-ee8aec0b-051a-40a0-9a77-42e0d87e718d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Created allocations for migration d0c5d2c3-4b54-458a-93d0-7b0105b50ed9 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82011) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:16:03.095572 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-ee8aec0b-051a-40a0-9a77-42e0d87e718d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 4263ca38-6a7d-473b-ba4f-f75523e5dfd0] Calling prep_resize with selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"16a62ade-abe7-4fff-b6af-b1d7b02e694d": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["16a62ade-abe7-4fff-b6af-b1d7b02e694d"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=16a62ade-abe7-4fff-b6af-b1d7b02e694d,limits=SchedulerLimits,nodename='chh2-799894-1',service_host='chh2-799894-1')] {{(pid=82011) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 08:16:04.479272 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:16:04.529576 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:04.532913 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:04.797912 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:04.802701 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:04.804082 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:04.804789 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:04.876028 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Getting quotas for project f406405909654b1cb3234fe62427dfad. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:16:04.891543 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Getting quotas for user ced895afeb664891bb93141e80fa5b52 and project f406405909654b1cb3234fe62427dfad. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:16:04.983718 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] [instance: f3e456c6-1e0d-4024-823a-290bec63556d] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:04.985843 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:04.990041 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:05.136608 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] [instance: f3e456c6-1e0d-4024-823a-290bec63556d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:05.137423 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:05.138305 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:05.475983 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:05.476908 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ce88736c-2418-4c66-bc03-eb17805db4a7 tempest-ListServerFiltersTestJSON-1971621602 tempest-ListServerFiltersTestJSON-1971621602-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:15.114670 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:16:15.166390 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:15.167846 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:15.469656 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:15.471971 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:15.472958 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:15.473501 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:15.536676 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Getting quotas for project 6f64363ba6124a1e980cf6d7b67bbf9b. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:16:15.546594 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Getting quotas for user e1d1f2f74ef0454781639043aae2907c and project 6f64363ba6124a1e980cf6d7b67bbf9b. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:16:15.584945 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] [instance: 1ff6df9a-22c1-4de8-b85e-1e8db767fbab] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:15.586244 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:15.586838 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:15.710098 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] [instance: 1ff6df9a-22c1-4de8-b85e-1e8db767fbab] block_device_mapping [BlockDeviceMapping(attachment_id=f835a3fd-811f-4fb4-8468-b05c966e2d7f,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d63e6c4-fcf2-4462-8fb9-01d1d3932e61',volume_size=1,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:15.713513 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:15.714249 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:16.015143 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:16.015813 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6925bfb6-3cdd-47db-ba1d-601aeb622353 tempest-ServersTestBootFromVolume-834548801 tempest-ServersTestBootFromVolume-834548801-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:21.457411 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:16:21.522973 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:21.525231 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:21.816177 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:21.818707 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:21.823799 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:21.825258 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:21.880892 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:16:21.899427 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for user 26f6db26dd284bdd82d4d607a8622ed0 and project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:16:21.930144 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 6df76ccf-a516-40c1-9f70-3919d0776bc4] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:21.933886 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:21.934297 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:22.068704 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 6df76ccf-a516-40c1-9f70-3919d0776bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:22.070205 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:22.073768 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:22.411734 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:22.412081 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b2cf81e2-9fe4-402a-82db-71ca125bbd58 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:26.311605 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:16:26.364403 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:26.365423 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:26.538856 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:26.544798 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:26.544798 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:26.544798 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:26.589193 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Getting quotas for project c789de41530f4abbb5bbacc2745650aa. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:16:26.603553 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Getting quotas for user 0d57d63728804a4bb7ee737719510d3a and project c789de41530f4abbb5bbacc2745650aa. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:16:26.624196 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] [instance: a3988ffc-6e24-4cbc-b1a1-6a1c94711125] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:26.625449 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:26.626033 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:26.714599 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] [instance: a3988ffc-6e24-4cbc-b1a1-6a1c94711125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:26.716161 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:26.716759 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:27.862597 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:27.863302 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ed9df12c-8e43-44f8-859b-ea39a89469d5 tempest-ServersAdminNegativeTestJSON-819778012 tempest-ServersAdminNegativeTestJSON-819778012-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:29.091278 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:16:29.136651 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:29.137050 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:29.568521 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:29.568924 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:29.569636 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:29.570143 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:29.616723 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:16:29.639428 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for user 5778cfa0be07463b97e6a79469bbc5a2 and project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:16:29.671213 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: d9dc61e0-6e98-4201-937a-3ccd0593789a] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:29.677399 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:29.677797 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:29.888688 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: d9dc61e0-6e98-4201-937a-3ccd0593789a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:29.895034 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:29.895034 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:30.297141 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:30.298647 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-aaa69ad0-b58d-4765-a081-b8d79a6b0269 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:47.793335 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:47.793975 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:48.547655 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Took 0.70 seconds to select destinations for 2 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:16:48.573271 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:48.573932 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:48.693287 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:48.694328 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:48.811799 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:48.812977 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:48.813874 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:48.814549 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:48.832952 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:16:48.838718 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for user 26f6db26dd284bdd82d4d607a8622ed0 and project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:16:48.850140 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: cc15a284-f864-4d7e-a384-913aa9a6967b] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:48.851654 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:48.852049 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:48.933668 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: cc15a284-f864-4d7e-a384-913aa9a6967b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:48.936633 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:48.936633 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:49.322348 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:49.322722 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:49.340792 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 508b759b-a745-44f9-abbf-e354a5764f5f] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:49.343609 chdv-799894-1 nova-conductor[82010]: DEBUG nova.objects.instance_group [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lazy-loading 'hosts' on InstanceGroup uuid d8dfbeaa-0036-43c0-aaf2-5345324f7105 {{(pid=82010) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Jul 08 08:16:49.374446 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:49.375863 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:49.484863 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 508b759b-a745-44f9-abbf-e354a5764f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:49.486721 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:49.487333 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:49.669554 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:16:49.735223 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:49.736858 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:49.796908 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:49.797583 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bf5da028-0fc6-4fea-848c-96488d360c7b tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:49.905035 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:49.905490 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:49.906263 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:49.906831 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:49.928161 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Getting quotas for project 18b1ac03b3d04b62a58d48c6cf118726. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:16:49.935338 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Getting quotas for user 6cf1aaab99ab4abfa7a5f2a4c041b87d and project 18b1ac03b3d04b62a58d48c6cf118726. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:16:49.959402 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 04149e11-3e8f-42ca-bc65-f035520f4653] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:49.960698 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:49.961326 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:50.150852 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 04149e11-3e8f-42ca-bc65-f035520f4653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:50.152525 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:50.152866 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:50.467799 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:50.468580 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cf820318-9d55-46b6-9637-62df7d9fa83d tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:51.195038 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:16:51.230235 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:51.230833 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:51.432590 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:51.433372 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:51.434334 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:51.435396 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:51.470117 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Getting quotas for project ae3d48c570204ec1871aa553689de9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:16:51.476757 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Getting quotas for user 0c4c42376cbd4b66b2f335630512057a and project ae3d48c570204ec1871aa553689de9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:16:51.496321 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] [instance: aa24f98f-0f80-45ff-a0d0-95e9cf5ee34f] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:16:51.496321 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:51.496321 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:51.577032 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] [instance: aa24f98f-0f80-45ff-a0d0-95e9cf5ee34f] block_device_mapping [BlockDeviceMapping(attachment_id=d40f8963-adff-498c-9335-e355b958b595,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e2d0424-3e9b-4f59-8443-e94bd25377a1',volume_size=1,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:16:51.578298 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:51.578695 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:16:51.938229 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:16:51.938686 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-11ed0e85-f24a-4bde-a41f-0eb824ffb944 tempest-LiveAutoBlockMigrationV225Test-593803781 tempest-LiveAutoBlockMigrationV225Test-593803781-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:15.792157 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:15.797984 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:16.902433 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Took 1.07 seconds to select destinations for 2 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:17:16.923336 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-1fc484d5-7225-4b6f-a325-108d52307e47 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:17:16.923954 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-1fc484d5-7225-4b6f-a325-108d52307e47 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:16.924586 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-1fc484d5-7225-4b6f-a325-108d52307e47 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:16.933977 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:16.934584 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:17.094337 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:17.095205 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:17.221711 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:17.222321 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:17.225341 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:17.236679 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:17.261088 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:17:17.266690 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for user 26f6db26dd284bdd82d4d607a8622ed0 and project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:17:17.279390 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 74f0b9e7-373b-4156-bcaa-af69d86cf404] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:17:17.281405 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:17.282313 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:17.314666 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-1fc484d5-7225-4b6f-a325-108d52307e47 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 04149e11-3e8f-42ca-bc65-f035520f4653] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 08:17:17.369548 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 74f0b9e7-373b-4156-bcaa-af69d86cf404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:17:17.371519 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:17.372228 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:17.625108 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:17.625108 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:17.625839 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 6e956e86-9b5a-42e0-8b47-67f70f9e57b6] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:17:17.626332 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance_group [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lazy-loading 'hosts' on InstanceGroup uuid 1462b500-38c9-44ba-871b-04abb2bf00c5 {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Jul 08 08:17:17.637599 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:17.638005 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:17.689726 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 6e956e86-9b5a-42e0-8b47-67f70f9e57b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:17:17.691092 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:17.691369 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:18.080633 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-1fc484d5-7225-4b6f-a325-108d52307e47 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Created allocations for migration bd29c5ba-0e9c-41c8-a17d-7ac8b0c4d5ba on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:17:18.081698 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:18.082648 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-921a1248-67cf-45df-9705-b0a52f3531e2 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:18.509895 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-1fc484d5-7225-4b6f-a325-108d52307e47 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 04149e11-3e8f-42ca-bc65-f035520f4653] Calling prep_resize with selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"16a62ade-abe7-4fff-b6af-b1d7b02e694d": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["16a62ade-abe7-4fff-b6af-b1d7b02e694d"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=16a62ade-abe7-4fff-b6af-b1d7b02e694d,limits=SchedulerLimits,nodename='chh2-799894-1',service_host='chh2-799894-1')] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 08:17:20.917062 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-d4bee175-e128-4f71-a0b6-f109e09bbdc5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:17:20.917679 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-d4bee175-e128-4f71-a0b6-f109e09bbdc5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:20.918173 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-d4bee175-e128-4f71-a0b6-f109e09bbdc5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:21.777346 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-d4bee175-e128-4f71-a0b6-f109e09bbdc5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Created allocations for migration 9fb2b287-9a91-4d67-a7e2-be93ef1e27d5 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82011) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:17:22.172614 chdv-799894-1 nova-conductor[82011]: DEBUG nova.scheduler.utils [None req-d4bee175-e128-4f71-a0b6-f109e09bbdc5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] [instance: aa24f98f-0f80-45ff-a0d0-95e9cf5ee34f] Instance allocations successfully created on destination node 16a62ade-abe7-4fff-b6af-b1d7b02e694d: {'allocations': {'16a62ade-abe7-4fff-b6af-b1d7b02e694d': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=82011) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Jul 08 08:17:22.172614 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-d4bee175-e128-4f71-a0b6-f109e09bbdc5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lazy-loading 'resources' on Instance uuid aa24f98f-0f80-45ff-a0d0-95e9cf5ee34f {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:17:22.179726 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-d4bee175-e128-4f71-a0b6-f109e09bbdc5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] Lazy-loading 'pci_requests' on Instance uuid aa24f98f-0f80-45ff-a0d0-95e9cf5ee34f {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:17:22.770949 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.live_migrate [None req-d4bee175-e128-4f71-a0b6-f109e09bbdc5 tempest-LiveAutoBlockMigrationV225Test-1570468283 tempest-LiveAutoBlockMigrationV225Test-1570468283-project-admin] [instance: aa24f98f-0f80-45ff-a0d0-95e9cf5ee34f] Start binding ports on destination host: chh2-799894-1 {{(pid=82011) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Jul 08 08:17:30.199461 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:17:31.224271 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53398. Jul 08 08:17:35.637419 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:17:38.250003 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:17:38.275103 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:38.275508 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:38.513704 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:38.514361 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:38.515801 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:38.516362 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:38.541117 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Getting quotas for project 83baac4afa0d401ba3bd45dc47f5726e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:17:38.546921 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Getting quotas for user 71da85a5831240248df080eaf1abbb67 and project 83baac4afa0d401ba3bd45dc47f5726e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:17:38.559349 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] [instance: e4f82f0b-7eff-4c0f-8b84-83b7a697dd0b] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:17:38.560282 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:38.560883 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:38.648658 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] [instance: e4f82f0b-7eff-4c0f-8b84-83b7a697dd0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:17:38.652747 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:38.652747 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:38.955197 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:38.955796 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3b7e98b4-53c6-4a76-956c-d0738d996bec tempest-TenantUsagesTestJSON-150852250 tempest-TenantUsagesTestJSON-150852250-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:46.221327 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:17:46.252852 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:46.253291 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:46.392048 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:46.392734 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:46.394107 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:46.394685 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:46.431647 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:17:46.438184 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for user 26f6db26dd284bdd82d4d607a8622ed0 and project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:17:46.451062 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 708811f5-abfe-413b-a6ea-17fe1b50c716] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:17:46.453317 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:46.453878 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:46.511042 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 708811f5-abfe-413b-a6ea-17fe1b50c716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:17:46.512300 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:46.512739 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:46.786248 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:17:46.787165 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ddb3da45-58ab-49b6-a991-a40ecbe30fc5 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:17:57.281417 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:18:03.894435 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:18:03.930545 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:03.931092 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:04.106159 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:04.110019 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:04.111018 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:04.111415 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:04.132856 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:18:04.138422 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for user 26f6db26dd284bdd82d4d607a8622ed0 and project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:18:04.152714 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 55680046-5210-48ef-8ab2-62d32af48733] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:18:04.153845 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:04.154399 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:04.213081 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 55680046-5210-48ef-8ab2-62d32af48733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:18:04.214367 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:04.214769 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:04.453878 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:04.454551 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ce21f847-bb62-46e5-a884-edc0da9bc551 tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:20.957720 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:18:21.003457 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:21.005286 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:21.162572 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:21.162979 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:21.163690 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:21.168084 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:21.224525 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:18:21.240384 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Getting quotas for user 26f6db26dd284bdd82d4d607a8622ed0 and project 107b8c5e270c458da5021d7581cec42a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:18:21.260289 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 3f83ce3c-ec87-4045-9533-01f9b3291c76] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:18:21.261221 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:21.261618 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:21.344561 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] [instance: 3f83ce3c-ec87-4045-9533-01f9b3291c76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:18:21.345932 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:21.346336 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:21.580223 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:21.580223 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b0064f7a-d334-4d2a-b5d0-38ac242e160f tempest-ServersOnMultiNodesTest-686010888 tempest-ServersOnMultiNodesTest-686010888-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:24.560254 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:18:24.606440 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:24.611143 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:24.796609 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:24.796609 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:24.796609 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:24.796609 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:24.856001 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Getting quotas for project 18b1ac03b3d04b62a58d48c6cf118726. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:18:24.885360 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Getting quotas for user 6cf1aaab99ab4abfa7a5f2a4c041b87d and project 18b1ac03b3d04b62a58d48c6cf118726. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:18:24.905807 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 87ae59b5-6446-49e7-b8c1-859ec8b660eb] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:18:24.905807 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:24.905807 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:24.962028 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] [instance: 87ae59b5-6446-49e7-b8c1-859ec8b660eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:18:24.963357 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:24.963762 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:25.322907 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:25.324814 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3780b409-105f-410e-b031-950c4a1a2fc2 tempest-MigrationsAdminTest-2118657908 tempest-MigrationsAdminTest-2118657908-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:46.047115 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:18:46.088913 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:46.088913 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:46.288292 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:46.288716 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:46.289717 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:46.290044 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:46.306041 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Getting quotas for project 47c3ab759bb640208e14a408ab175f02. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:18:46.310870 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Getting quotas for user 3c79cb9e972e4badbb3fcea5e14c05ed and project 47c3ab759bb640208e14a408ab175f02. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:18:46.324759 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] [instance: bbd1dacf-59e2-44ef-944c-46b78cc270e6] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:18:46.326082 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:46.326633 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:46.405152 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] [instance: bbd1dacf-59e2-44ef-944c-46b78cc270e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:18:46.410736 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:46.410736 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:46.651621 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:46.652206 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9e7b8194-eafe-481b-b521-b0dd4f103a3a tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:56.488880 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-10c5c5c4-99ca-4f6b-9c6d-749ae501edd0 tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:18:56.490014 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-10c5c5c4-99ca-4f6b-9c6d-749ae501edd0 tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:18:56.490577 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-10c5c5c4-99ca-4f6b-9c6d-749ae501edd0 tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:18:57.499774 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-10c5c5c4-99ca-4f6b-9c6d-749ae501edd0 tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] [instance: 87ae59b5-6446-49e7-b8c1-859ec8b660eb] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 08:18:58.597952 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-10c5c5c4-99ca-4f6b-9c6d-749ae501edd0 tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] Created allocations for migration cfd6e91d-078e-4eed-8de7-b2267d316c89 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:18:59.226313 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-10c5c5c4-99ca-4f6b-9c6d-749ae501edd0 tempest-MigrationsAdminTest-525726012 tempest-MigrationsAdminTest-525726012-project-admin] [instance: 87ae59b5-6446-49e7-b8c1-859ec8b660eb] Calling prep_resize with selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 08:19:13.081826 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-92acce95-868a-43fb-90dd-b549cada5919 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:19:13.082691 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-92acce95-868a-43fb-90dd-b549cada5919 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:13.082928 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-92acce95-868a-43fb-90dd-b549cada5919 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:14.077802 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-92acce95-868a-43fb-90dd-b549cada5919 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Created allocations for migration cde4a426-8f97-4b62-b6f9-358bedb184a8 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82011) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:19:14.450797 chdv-799894-1 nova-conductor[82011]: DEBUG nova.scheduler.utils [None req-92acce95-868a-43fb-90dd-b549cada5919 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] [instance: bbd1dacf-59e2-44ef-944c-46b78cc270e6] Instance allocations successfully created on destination node 16a62ade-abe7-4fff-b6af-b1d7b02e694d: {'allocations': {'16a62ade-abe7-4fff-b6af-b1d7b02e694d': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=82011) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Jul 08 08:19:14.450797 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-92acce95-868a-43fb-90dd-b549cada5919 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lazy-loading 'resources' on Instance uuid bbd1dacf-59e2-44ef-944c-46b78cc270e6 {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:19:14.456264 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-92acce95-868a-43fb-90dd-b549cada5919 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lazy-loading 'pci_requests' on Instance uuid bbd1dacf-59e2-44ef-944c-46b78cc270e6 {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:19:15.018499 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.live_migrate [None req-92acce95-868a-43fb-90dd-b549cada5919 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] [instance: bbd1dacf-59e2-44ef-944c-46b78cc270e6] Start binding ports on destination host: chh2-799894-1 {{(pid=82011) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Jul 08 08:19:25.538179 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:19:25.572403 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:25.573142 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:25.934540 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:25.935255 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:25.936157 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:25.936774 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:25.958550 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Getting quotas for project 34cd7eb9e2ba467eb5f5d492b32d9d77. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:19:25.965808 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Getting quotas for user 069ed9242f72473db5fea6b846a2cc90 and project 34cd7eb9e2ba467eb5f5d492b32d9d77. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:19:25.980093 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] [instance: 926d78a3-e8c3-468c-a9bf-0098a8b39b24] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:19:25.981482 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:25.982152 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:26.089755 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] [instance: 926d78a3-e8c3-468c-a9bf-0098a8b39b24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='225705c6-d9b8-4741-9bc2-10df84a0ee7d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:19:26.091545 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:26.092182 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:26.398372 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:26.398788 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-293bd90b-42b3-484a-8648-c42b010c319c tempest-AttachSCSIVolumeTestJSON-1170728949 tempest-AttachSCSIVolumeTestJSON-1170728949-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:29.862943 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:19:29.901955 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:29.902480 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:30.177790 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:30.178316 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:30.179176 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:30.184297 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:30.243302 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Getting quotas for project fd304082260e4e5fa3dda5f6fd80885a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:19:30.258440 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Getting quotas for user efc31000dce240909f01188ebfb68665 and project fd304082260e4e5fa3dda5f6fd80885a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:19:30.315809 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] [instance: f55ebef0-c5aa-4ac2-a97d-152ed85a5e97] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:19:30.317260 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:30.317939 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:30.393925 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] [instance: f55ebef0-c5aa-4ac2-a97d-152ed85a5e97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:19:30.398904 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:30.398904 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:30.610213 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:30.611005 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b474cce5-e6ea-4836-ae0c-bd4077b66811 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:49.336255 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:19:49.379138 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:49.379542 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:49.561370 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:49.561781 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:49.563041 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:49.563432 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:49.581487 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Getting quotas for project 47c3ab759bb640208e14a408ab175f02. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:19:49.595552 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Getting quotas for user 3c79cb9e972e4badbb3fcea5e14c05ed and project 47c3ab759bb640208e14a408ab175f02. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:19:49.630297 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] [instance: a2783092-f2b9-4533-8f22-0bd632ed1b25] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:19:49.631739 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:49.633279 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:49.704021 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] [instance: a2783092-f2b9-4533-8f22-0bd632ed1b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:19:49.706614 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:49.707324 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:50.136529 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:50.136529 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0989580a-84e1-48ff-9a38-22f5efcf9deb tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:55.783658 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:19:55.813547 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:55.814240 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:55.980306 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:55.980752 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:55.981604 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:55.982007 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:55.998809 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Getting quotas for project 4c5c405aaeca4d678ea638ea844b2418. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:19:56.004501 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Getting quotas for user b2072ed7b2c84411853b496b74f8e953 and project 4c5c405aaeca4d678ea638ea844b2418. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:19:56.014802 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] [instance: a302d01f-e7b5-44cf-bb93-ab3f965f5573] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:19:56.016841 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:56.017247 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:56.094637 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] [instance: a302d01f-e7b5-44cf-bb93-ab3f965f5573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:19:56.095948 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:56.096372 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:19:56.386095 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:19:56.386505 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-cbdbc45b-70d2-4c5f-bf99-cc0b48f21b63 tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:13.655853 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-feb29dac-7f1e-4208-b7f0-8516fea1eeb2 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:20:13.656474 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-feb29dac-7f1e-4208-b7f0-8516fea1eeb2 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:13.656768 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-feb29dac-7f1e-4208-b7f0-8516fea1eeb2 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:14.315711 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-feb29dac-7f1e-4208-b7f0-8516fea1eeb2 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Created allocations for migration d3d7ed5b-49fc-431f-9728-2cc9593d18b7 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:20:14.622683 chdv-799894-1 nova-conductor[82010]: DEBUG nova.scheduler.utils [None req-feb29dac-7f1e-4208-b7f0-8516fea1eeb2 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] [instance: a2783092-f2b9-4533-8f22-0bd632ed1b25] Instance allocations successfully created on destination node 16a62ade-abe7-4fff-b6af-b1d7b02e694d: {'allocations': {'16a62ade-abe7-4fff-b6af-b1d7b02e694d': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=82010) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Jul 08 08:20:14.623333 chdv-799894-1 nova-conductor[82010]: DEBUG nova.objects.instance [None req-feb29dac-7f1e-4208-b7f0-8516fea1eeb2 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lazy-loading 'resources' on Instance uuid a2783092-f2b9-4533-8f22-0bd632ed1b25 {{(pid=82010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:20:14.629416 chdv-799894-1 nova-conductor[82010]: DEBUG nova.objects.instance [None req-feb29dac-7f1e-4208-b7f0-8516fea1eeb2 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lazy-loading 'pci_requests' on Instance uuid a2783092-f2b9-4533-8f22-0bd632ed1b25 {{(pid=82010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:20:15.236684 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.live_migrate [None req-feb29dac-7f1e-4208-b7f0-8516fea1eeb2 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] [instance: a2783092-f2b9-4533-8f22-0bd632ed1b25] Start binding ports on destination host: chh2-799894-1 {{(pid=82010) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Jul 08 08:20:32.609772 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:20:32.677583 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:32.681343 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:32.864125 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:32.864877 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:32.865590 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:32.866138 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:32.887846 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Getting quotas for project 47c3ab759bb640208e14a408ab175f02. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:20:32.893848 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Getting quotas for user 3c79cb9e972e4badbb3fcea5e14c05ed and project 47c3ab759bb640208e14a408ab175f02. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:20:32.906084 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] [instance: 5262b230-7067-46bd-a58b-49d34f15d616] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:20:32.907451 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:32.908019 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:32.968690 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] [instance: 5262b230-7067-46bd-a58b-49d34f15d616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:20:32.970213 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:32.970778 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:33.259550 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:33.259957 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-99c02e4f-bc17-4db4-bd01-6b20c306f525 tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:54.275030 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:20:54.314439 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:54.315269 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:54.592857 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:54.593366 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:54.594344 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:54.596418 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:54.651843 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Getting quotas for project 1866b7253b4a4c49b04e2dc08d4e4a62. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:20:54.664804 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Getting quotas for user 9948de761b054b219836d3fb83304c72 and project 1866b7253b4a4c49b04e2dc08d4e4a62. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:20:54.703310 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] [instance: 7a2a9ebc-5fca-459e-90b3-4438ba1b332e] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:20:54.705057 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:54.707905 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:54.796452 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] [instance: 7a2a9ebc-5fca-459e-90b3-4438ba1b332e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:20:54.798461 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:54.799110 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:55.656946 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:20:55.658031 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-59043c53-fcbd-4eb1-a72c-521d387817cf tempest-VolumesAdminNegativeTest-75347211 tempest-VolumesAdminNegativeTest-75347211-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:20:55.660731 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:21:04.211672 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:21:04.258333 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:04.258745 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:04.427531 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:04.427531 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:04.427531 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:04.427770 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:04.479666 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Getting quotas for project 4c5c405aaeca4d678ea638ea844b2418. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:21:04.486034 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Getting quotas for user b2072ed7b2c84411853b496b74f8e953 and project 4c5c405aaeca4d678ea638ea844b2418. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:21:04.508189 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] [instance: c70987b9-6a5c-433b-a333-0cb917f2ad8a] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:21:04.509888 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:04.510294 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:04.578505 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] [instance: c70987b9-6a5c-433b-a333-0cb917f2ad8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:21:04.583117 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:04.583117 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:04.847137 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:04.847803 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5cf1fbf5-84f7-42ec-8c00-5b6b91b6123b tempest-ServersTestMultiNic-1771974860 tempest-ServersTestMultiNic-1771974860-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:06.736157 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:21:06.826001 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:06.826413 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:07.050670 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:07.052699 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:07.053519 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:07.057521 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:07.096545 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Getting quotas for project fd304082260e4e5fa3dda5f6fd80885a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:21:07.106925 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Getting quotas for user efc31000dce240909f01188ebfb68665 and project fd304082260e4e5fa3dda5f6fd80885a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:21:07.120715 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] [instance: 63327039-7d9b-4d57-a37f-37e44447c219] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:21:07.121941 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:07.122553 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:07.208079 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] [instance: 63327039-7d9b-4d57-a37f-37e44447c219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:21:07.209513 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:07.210013 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:07.540974 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:07.541382 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-21464c1d-77d1-4f8b-bdbe-0ae0f9707ef8 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:17.306862 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:21:19.387375 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b31ce66e-4b32-4824-9a59-7ea0f8362e65 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:21:19.387887 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b31ce66e-4b32-4824-9a59-7ea0f8362e65 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:21:19.388250 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b31ce66e-4b32-4824-9a59-7ea0f8362e65 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:21:20.731936 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-b31ce66e-4b32-4824-9a59-7ea0f8362e65 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Created allocations for migration b3bb58e0-99b9-47c8-b0c2-3320f8e1adc2 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82011) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:21:21.458227 chdv-799894-1 nova-conductor[82011]: DEBUG nova.scheduler.utils [None req-b31ce66e-4b32-4824-9a59-7ea0f8362e65 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] [instance: 5262b230-7067-46bd-a58b-49d34f15d616] Instance allocations successfully created on destination node 16a62ade-abe7-4fff-b6af-b1d7b02e694d: {'allocations': {'16a62ade-abe7-4fff-b6af-b1d7b02e694d': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=82011) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Jul 08 08:21:21.459019 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-b31ce66e-4b32-4824-9a59-7ea0f8362e65 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lazy-loading 'resources' on Instance uuid 5262b230-7067-46bd-a58b-49d34f15d616 {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:21:21.477280 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-b31ce66e-4b32-4824-9a59-7ea0f8362e65 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lazy-loading 'pci_requests' on Instance uuid 5262b230-7067-46bd-a58b-49d34f15d616 {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:21:22.081508 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.live_migrate [None req-b31ce66e-4b32-4824-9a59-7ea0f8362e65 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] [instance: 5262b230-7067-46bd-a58b-49d34f15d616] Start binding ports on destination host: chh2-799894-1 {{(pid=82011) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Jul 08 08:22:31.226206 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:22:32.270211 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58494. Jul 08 08:22:42.748897 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Took 2.11 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:22:42.797898 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:42.800561 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:43.151383 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:43.151978 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:43.155086 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:43.155494 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:43.237653 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Getting quotas for project 39f796edbc39435dbd9e95266baf4b6f. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:22:43.283948 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Getting quotas for user eac2d29ecace4e0e9772837a07558ba1 and project 39f796edbc39435dbd9e95266baf4b6f. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:22:43.311309 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] [instance: 3c0485e3-1788-482d-8fcb-bad579879b9d] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:22:43.318977 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:43.320231 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:43.383267 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] [instance: 3c0485e3-1788-482d-8fcb-bad579879b9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:22:43.385098 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:43.385916 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:43.750008 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:43.750008 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-584cc994-98e7-4527-9913-447b52da36da tempest-ServersTestManualDisk-1392720655 tempest-ServersTestManualDisk-1392720655-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:50.351098 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:22:50.406618 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:50.407023 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:50.604485 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:50.604889 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:50.605600 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:50.605982 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:50.669552 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Getting quotas for project 47c3ab759bb640208e14a408ab175f02. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:22:50.682097 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Getting quotas for user 3c79cb9e972e4badbb3fcea5e14c05ed and project 47c3ab759bb640208e14a408ab175f02. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:22:50.705970 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] [instance: 7f2a3377-4653-47f3-b561-6a9a4ceb1302] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:22:50.710320 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:50.710725 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:50.795735 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] [instance: 7f2a3377-4653-47f3-b561-6a9a4ceb1302] block_device_mapping [BlockDeviceMapping(attachment_id=dfa814b5-823a-4db3-9717-42f9a3926c5c,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6cc47d05-a3bf-4398-82a9-206dfee5effe',volume_size=1,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:22:50.797333 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:50.797990 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:51.079172 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:51.080199 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-194c1868-67c5-4c25-ab52-3ae2ae8f3aba tempest-LiveMigrationTest-285029953 tempest-LiveMigrationTest-285029953-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:57.415910 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:22:57.451456 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:57.451762 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:57.714357 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:57.715057 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:57.715981 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:57.716566 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:57.742949 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Getting quotas for project 65fbc0f554e74ac88d1266f471ec3a56. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:22:57.750199 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Getting quotas for user 7a69d2205a2e4ecd87c2be616a4154a4 and project 65fbc0f554e74ac88d1266f471ec3a56. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:22:57.768311 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] [instance: 7d321545-79e8-420c-a10a-5da52b155218] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:22:57.769496 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:57.776853 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:57.845401 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] [instance: 7d321545-79e8-420c-a10a-5da52b155218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:22:57.847191 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:57.848043 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:22:58.126803 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:22:58.127874 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25199cc6-324c-46e6-a13e-78317533f872 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879 tempest-FloatingIPsAssociationNegativeTestJSON-1683362879-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:01.081852 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:23:01.107961 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:01.108506 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:01.303349 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:01.307282 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:01.309084 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:01.311211 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:01.364720 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:23:01.374225 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for user 5778cfa0be07463b97e6a79469bbc5a2 and project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:23:01.395580 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: 9159ffd4-a5c1-4cbd-9bdc-2eb5c170ff9a] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:23:01.400500 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:01.402705 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:01.466712 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: 9159ffd4-a5c1-4cbd-9bdc-2eb5c170ff9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:23:01.468035 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:01.468465 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:01.737622 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:01.738318 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ac07044a-fcd4-47ea-9543-491fc362117a tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:02.895791 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:23:02.949169 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:02.949573 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:03.278773 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:03.279188 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:03.280029 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:03.284988 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:03.335472 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Getting quotas for project f62dc6fc78814129bc4bac9892b7822f. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:23:03.345436 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Getting quotas for user 219589d5d719425da9d716eb892f77ce and project f62dc6fc78814129bc4bac9892b7822f. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:23:03.375103 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] [instance: 895f9d7f-544b-47ad-855e-a05da5781462] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:23:03.376331 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:03.376929 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:03.490347 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] [instance: 895f9d7f-544b-47ad-855e-a05da5781462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:23:03.493114 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:03.493798 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:03.840222 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:03.841013 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5a34cb8d-fda3-4e97-bd9e-9bfad2adc2dd tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:04.359137 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:23:04.410863 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:04.419387 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:04.557909 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:04.558668 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:04.559635 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:04.560224 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:04.595321 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Getting quotas for project fd304082260e4e5fa3dda5f6fd80885a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:23:04.619201 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Getting quotas for user efc31000dce240909f01188ebfb68665 and project fd304082260e4e5fa3dda5f6fd80885a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:23:04.651369 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] [instance: 78795c38-91bf-4359-a0c8-4d75bdfb9b51] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:23:04.653064 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:04.653677 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:04.735152 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] [instance: 78795c38-91bf-4359-a0c8-4d75bdfb9b51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:23:04.736472 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:04.736879 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:04.983585 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:04.984284 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0e4f7de4-b61e-495c-9e3c-5ad03c6d07c6 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:07.874367 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:23:07.905045 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:07.905697 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:08.074066 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:08.074480 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:08.075264 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:08.075660 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:08.109532 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Getting quotas for project f62dc6fc78814129bc4bac9892b7822f. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:23:08.120840 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Getting quotas for user 219589d5d719425da9d716eb892f77ce and project f62dc6fc78814129bc4bac9892b7822f. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:23:08.137409 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] [instance: 74d53898-1697-4acf-b4d6-879f8e6a3c52] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:23:08.138828 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:08.140011 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:08.229977 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] [instance: 74d53898-1697-4acf-b4d6-879f8e6a3c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:23:08.238509 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:08.239843 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:08.496452 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:08.496857 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c298961b-e4fa-49f5-ab35-128c8ee8db24 tempest-ServerRescueNegativeTestJSON-396935212 tempest-ServerRescueNegativeTestJSON-396935212-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:20.646199 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-083749f5-84e3-4a18-90a6-61901a0ee110 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:23:20.647111 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-083749f5-84e3-4a18-90a6-61901a0ee110 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:23:20.647336 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-083749f5-84e3-4a18-90a6-61901a0ee110 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:23:21.310422 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-083749f5-84e3-4a18-90a6-61901a0ee110 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Created allocations for migration de9db802-b341-4f10-af8d-d8e24e2404d8 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82011) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:23:21.554598 chdv-799894-1 nova-conductor[82011]: DEBUG nova.scheduler.utils [None req-083749f5-84e3-4a18-90a6-61901a0ee110 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] [instance: 7f2a3377-4653-47f3-b561-6a9a4ceb1302] Instance allocations successfully created on destination node 16a62ade-abe7-4fff-b6af-b1d7b02e694d: {'allocations': {'16a62ade-abe7-4fff-b6af-b1d7b02e694d': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=82011) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Jul 08 08:23:21.555029 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-083749f5-84e3-4a18-90a6-61901a0ee110 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lazy-loading 'resources' on Instance uuid 7f2a3377-4653-47f3-b561-6a9a4ceb1302 {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:23:21.559639 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-083749f5-84e3-4a18-90a6-61901a0ee110 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] Lazy-loading 'pci_requests' on Instance uuid 7f2a3377-4653-47f3-b561-6a9a4ceb1302 {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:23:22.212485 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:23:23.234505 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59242. Jul 08 08:23:23.265993 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.live_migrate [None req-083749f5-84e3-4a18-90a6-61901a0ee110 tempest-LiveMigrationTest-418906943 tempest-LiveMigrationTest-418906943-project-admin] [instance: 7f2a3377-4653-47f3-b561-6a9a4ceb1302] Start binding ports on destination host: chh2-799894-1 {{(pid=82011) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Jul 08 08:24:13.858755 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:24:13.900555 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:13.900987 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:14.034844 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:14.039040 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:14.040182 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:14.048399 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:14.075489 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:24:14.080969 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for user 5778cfa0be07463b97e6a79469bbc5a2 and project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:24:14.096832 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: 0197ad90-85db-413c-bd22-8794867ad2d6] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:24:14.098286 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:14.099053 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:14.207884 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: 0197ad90-85db-413c-bd22-8794867ad2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:24:14.210096 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:14.210507 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:14.441639 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:14.442047 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6e941bbd-37c7-4986-bb94-a180ddd8eeba tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:15.688018 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:24:19.425063 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:24:19.498159 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:19.500973 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:19.683246 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:19.684738 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:19.685724 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:19.686336 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:19.711845 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Getting quotas for project fd304082260e4e5fa3dda5f6fd80885a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:24:19.724392 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Getting quotas for user efc31000dce240909f01188ebfb68665 and project fd304082260e4e5fa3dda5f6fd80885a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:24:19.755987 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] [instance: 1a03e008-a8c2-4c74-9947-bc93273fafae] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:24:19.757584 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:19.760556 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:19.870131 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] [instance: 1a03e008-a8c2-4c74-9947-bc93273fafae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:24:19.871410 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:19.871816 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:20.190269 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:20.190668 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-07367667-4952-4c20-a5f0-c3bf5db88ee2 tempest-ImagesTestJSON-954382932 tempest-ImagesTestJSON-954382932-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:37.333543 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:24:37.752623 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Took 1.14 seconds to select destinations for 2 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:24:37.838548 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:37.839505 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:38.102684 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:38.103299 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:38.254862 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:38.255179 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:38.255895 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:38.256291 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:38.289860 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Getting quotas for project 4e004a9ea57144a1a2458f0ef052fe89. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:24:38.298734 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Getting quotas for user 2fe0a7b62c2949bd80008b7391aba60d and project 4e004a9ea57144a1a2458f0ef052fe89. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:24:38.327577 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] [instance: b7617213-716e-454e-ae5c-74b684017fc8] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:24:38.328682 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:38.329354 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:38.405424 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] [instance: b7617213-716e-454e-ae5c-74b684017fc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:24:38.408210 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:38.408839 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:38.681313 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:38.687182 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:38.699969 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] [instance: 04777e72-e4ad-47ee-9922-7a406d3cc55a] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:24:38.701662 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:38.702670 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:38.801616 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] [instance: 04777e72-e4ad-47ee-9922-7a406d3cc55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:24:38.803552 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:38.806862 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:39.201171 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:39.201983 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4451b883-ea78-44b9-85c1-47d34eb5bd40 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:44.447056 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:24:44.469456 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:44.469868 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:44.553558 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:24:44.592907 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:44.593512 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:44.735462 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:44.735883 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:44.736712 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:44.737113 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:44.763150 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Getting quotas for project a0d21144d06e4947a06b685813af1674. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:24:44.768531 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Getting quotas for user c177fa3afe37485d96611612f4b983e1 and project a0d21144d06e4947a06b685813af1674. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:24:44.783075 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] [instance: 9313f1ad-3046-4e0b-930d-ed62733d277b] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:24:44.784203 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:44.785507 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:44.860533 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:44.861422 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:44.862364 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:44.863323 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:44.884011 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Getting quotas for project 6d9980a18df549ffa28de12d4ddcaff6. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:24:44.888836 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Getting quotas for user 57b1e55f0a7a4b1f90713668c743fa5e and project 6d9980a18df549ffa28de12d4ddcaff6. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:24:44.897378 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] [instance: 9313f1ad-3046-4e0b-930d-ed62733d277b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:24:44.898611 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:44.899010 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:44.901189 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] [instance: 2782874a-d820-4c2c-97a3-87fbc6929114] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:24:44.902301 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:44.902973 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:45.017471 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] [instance: 2782874a-d820-4c2c-97a3-87fbc6929114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:24:45.019821 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:45.020752 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:45.189348 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:45.189698 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8d2f215b-31da-4145-8ce8-0041e432af3a tempest-ImagesOneServerTestJSON-745770850 tempest-ImagesOneServerTestJSON-745770850-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:24:45.349196 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:24:45.350110 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f6d0544f-94ff-4314-83fb-b30c50354273 tempest-ServersTestJSON-252804782 tempest-ServersTestJSON-252804782-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:08.353847 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Took 0.80 seconds to select destinations for 2 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:25:08.403950 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:08.404590 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:08.609370 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:08.609878 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:08.812248 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:08.813003 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:08.813736 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:08.814138 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:08.833559 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Getting quotas for project 4e004a9ea57144a1a2458f0ef052fe89. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:25:08.838428 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Getting quotas for user 2fe0a7b62c2949bd80008b7391aba60d and project 4e004a9ea57144a1a2458f0ef052fe89. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:25:08.851199 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] [instance: 7a68bf7d-db35-46b7-b1b4-232bf6443a63] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:25:08.852160 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:08.854906 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:08.943134 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] [instance: 7a68bf7d-db35-46b7-b1b4-232bf6443a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:25:08.944787 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:08.945308 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:09.256914 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:09.257330 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:09.273135 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] [instance: c7ccf2e9-68ce-4c33-87ee-27e5a4ae9b43] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:25:09.274359 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:09.274938 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:09.360215 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] [instance: c7ccf2e9-68ce-4c33-87ee-27e5a4ae9b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:25:09.362708 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:09.363531 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:09.686563 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:09.687290 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-073c42ee-11a1-442f-a5db-7f19864414b0 tempest-MultipleCreateTestJSON-504029682 tempest-MultipleCreateTestJSON-504029682-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:13.475071 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Took 1.04 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:25:13.518912 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:13.519325 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:13.707883 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:13.708581 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:13.709713 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:13.710260 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:13.731452 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Getting quotas for project e2b38083da8d41f1ae7d0b542dd2fb12. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:25:13.739238 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Getting quotas for user 22fc258a7292482786dd4f7314c24097 and project e2b38083da8d41f1ae7d0b542dd2fb12. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:25:13.752602 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] [instance: a9f45924-b95e-4b7d-87f6-d69125945f50] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:25:13.754077 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:13.754955 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:13.811430 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] [instance: a9f45924-b95e-4b7d-87f6-d69125945f50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:25:13.812954 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:13.813579 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:14.120634 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:14.122179 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-341be013-20ab-4c8d-b1d3-0dba2db21ec1 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:16.129160 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:25:16.156083 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:16.156797 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:16.424680 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:16.425277 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:16.426149 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:16.426863 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:16.450203 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Getting quotas for project 9d2ff8e4934c41eaafd0bc457ec29d35. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:25:16.454987 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Getting quotas for user 044ea94d95524431967e41b3e6b9e434 and project 9d2ff8e4934c41eaafd0bc457ec29d35. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:25:16.470372 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] [instance: b3bcdc70-6858-433c-b322-4832b523e2b7] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:25:16.472136 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:16.472714 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:16.543118 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] [instance: b3bcdc70-6858-433c-b322-4832b523e2b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:25:16.544415 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:16.544989 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:16.926121 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:16.926758 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-60c05b4b-d63f-4061-ac88-0da9b6e9f894 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:18.001905 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:25:18.028636 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:18.029198 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:18.131959 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:18.132450 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:18.133315 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:18.133816 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:18.153417 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Getting quotas for project 9d2ff8e4934c41eaafd0bc457ec29d35. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:25:18.158998 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Getting quotas for user 044ea94d95524431967e41b3e6b9e434 and project 9d2ff8e4934c41eaafd0bc457ec29d35. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:25:18.170923 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] [instance: d545ce27-8a54-4d55-9ba2-c8cd86dd0088] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:25:18.173474 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:18.174041 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:18.241360 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] [instance: d545ce27-8a54-4d55-9ba2-c8cd86dd0088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:25:18.242647 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:18.243048 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:18.549421 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:18.550358 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-be99638b-469f-4760-b0c3-110fe0b30156 tempest-ListImageFiltersTestJSON-1972727827 tempest-ListImageFiltersTestJSON-1972727827-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:32.267537 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:25:33.288186 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33398. Jul 08 08:25:53.460555 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:25:53.482582 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:53.482988 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:53.636551 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:53.637110 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:53.637830 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:53.638222 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:53.654495 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Getting quotas for project 65517b831c3842e3b304c9b0af675ec2. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:25:53.659710 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Getting quotas for user 708acce216b940f78b77d0236bdc1d24 and project 65517b831c3842e3b304c9b0af675ec2. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:25:53.670329 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] [instance: 0904b6dc-193d-42d6-a1f9-f3296934b017] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:25:53.671246 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:53.671676 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:53.763772 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] [instance: 0904b6dc-193d-42d6-a1f9-f3296934b017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:25:53.765032 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:53.766311 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:25:54.004358 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:25:54.004769 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9b950cd0-9b08-490c-86fb-bec4a024f3ef tempest-ServerAddressesTestJSON-750370638 tempest-ServerAddressesTestJSON-750370638-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:10.235850 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:26:10.286973 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:10.287467 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:10.481350 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:10.481849 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:10.482809 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:10.484110 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:10.527569 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Getting quotas for project e2b38083da8d41f1ae7d0b542dd2fb12. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:26:10.534050 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Getting quotas for user 22fc258a7292482786dd4f7314c24097 and project e2b38083da8d41f1ae7d0b542dd2fb12. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:26:10.547864 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] [instance: 56005fd1-3620-41bf-b28b-ab1a8a746144] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:26:10.550064 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:10.550064 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:10.626685 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] [instance: 56005fd1-3620-41bf-b28b-ab1a8a746144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:26:10.627926 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:10.628351 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:10.985441 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:10.986118 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84197563-d100-4a03-9ee0-b4adfe1e973d tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:23.235468 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:26:24.262951 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34576. Jul 08 08:26:51.577806 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:26:51.639266 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:51.640644 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:51.903864 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:51.907177 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:51.910529 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:51.913490 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:51.956324 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Getting quotas for project 361227cd3fb04b69a2d3edb63231bc89. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:26:51.973827 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Getting quotas for user a2db6a940573482f9028cbe1e590503c and project 361227cd3fb04b69a2d3edb63231bc89. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:26:52.004455 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] [instance: d57c0a08-2b40-4319-86b4-a4387d891bcc] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:26:52.007696 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:52.007696 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:52.084002 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] [instance: d57c0a08-2b40-4319-86b4-a4387d891bcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:26:52.085806 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:52.086932 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:26:52.388816 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:26:52.389400 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2aa61b32-8172-4e3f-a7d7-1d61290fc3d9 tempest-ServerRescueTestJSONUnderV235-1180940019 tempest-ServerRescueTestJSONUnderV235-1180940019-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:00.830031 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:27:00.917553 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:00.918049 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:01.055355 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:01.055942 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:01.057919 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:01.058484 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:01.095161 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Getting quotas for project e2b38083da8d41f1ae7d0b542dd2fb12. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:27:01.100410 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Getting quotas for user 22fc258a7292482786dd4f7314c24097 and project e2b38083da8d41f1ae7d0b542dd2fb12. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:27:01.125726 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] [instance: 17445b4e-309c-47c5-88fd-68598361f742] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:27:01.133774 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:01.134415 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:01.262251 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] [instance: 17445b4e-309c-47c5-88fd-68598361f742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:27:01.264041 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:01.264673 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:01.685088 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:01.685482 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a87f880-ecdf-4f0e-9599-dea4147441d5 tempest-ImagesOneServerNegativeTestJSON-181145895 tempest-ImagesOneServerNegativeTestJSON-181145895-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:15.199976 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:27:15.225317 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:15.228809 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:15.431288 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:15.431898 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:15.432649 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:15.433062 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:15.452492 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Getting quotas for project 3cfe1dcca1e74946b3ec6579e5458da7. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:27:15.456914 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Getting quotas for user fdd8aa45a0bf488e9bed6f6471c6c378 and project 3cfe1dcca1e74946b3ec6579e5458da7. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:27:15.467714 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] [instance: 3780a524-5f0c-482f-83d8-808e96bdd996] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:27:15.468753 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:15.469152 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:15.550363 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] [instance: 3780a524-5f0c-482f-83d8-808e96bdd996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:27:15.551663 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:15.552115 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:15.853240 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:15.854448 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9dd70350-b8ff-4279-bf70-92364d6d2c15 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:35.733525 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:27:42.855175 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Took 1.04 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:27:42.880178 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:42.880178 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:43.233975 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:43.234265 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:43.234985 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:43.235378 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:43.252251 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Getting quotas for project f3d32eb74223457ba5f8ec0a6b597a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:27:43.257329 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Getting quotas for user b21339b035cc4e7cb56946e8bebfc624 and project f3d32eb74223457ba5f8ec0a6b597a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:27:43.269415 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] [instance: 2b92b1b1-39c7-4087-bd6b-f35f30cdcbad] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:27:43.271614 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:43.271614 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:43.402593 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] [instance: 2b92b1b1-39c7-4087-bd6b-f35f30cdcbad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:27:43.404299 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:43.404963 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:43.915173 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:43.915814 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-84ffbe8f-0c11-4384-ac3f-78819b0e62fe tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:49.370081 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:27:49.392524 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:49.393143 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:49.656990 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:49.657620 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:49.658528 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:49.659079 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:49.678418 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:27:49.691242 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for user 9e66f7b82e574fda9fc592d6ba3ed140 and project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:27:49.695012 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: ea87be13-1ced-457d-9c50-d51dd3f93251] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:27:49.696385 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:49.696947 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:49.777852 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: ea87be13-1ced-457d-9c50-d51dd3f93251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:27:49.777852 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:49.777852 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:50.039225 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:27:50.039660 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-08aa7a2f-b9d3-4d6c-b4f1-1440e0a4525b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:27:57.364592 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:28:16.137414 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:28:16.160610 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:16.161016 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:16.383465 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:16.383874 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:16.385539 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:16.388881 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:16.405222 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Getting quotas for project 43d4606e74004e118832dc3d9a32dfaa. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:28:16.410025 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Getting quotas for user 5e97be0e44c3455fb5b394def83a3e6a and project 43d4606e74004e118832dc3d9a32dfaa. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:28:16.421416 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] [instance: 0a9d812e-b5de-4ed9-a872-b9d6811ecb0c] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:28:16.422492 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:16.422899 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:16.515569 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] [instance: 0a9d812e-b5de-4ed9-a872-b9d6811ecb0c] block_device_mapping [BlockDeviceMapping(attachment_id=42625b75-d58f-4bea-b596-1c197413e7bf,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='798eed9a-6828-4128-82bf-e882089441ee',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=628d737f-b4fe-4a85-8a47-c50b4c19272e,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='da0ce741-0b55-42f6-941f-3979cada52ac',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=5a9d7e6e-b7cd-4816-a4f9-0ebe12e19f95,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ea4d911-919e-4fc2-8378-1607ef561bec',volume_size=1,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:28:16.517320 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:16.517719 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:16.601942 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:16.602745 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:16.704299 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:16.704800 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:16.943459 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:16.944016 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-33dcc212-a927-4108-82a0-0b65fce9c815 tempest-TaggedBootDevicesTest_v242-1414061902 tempest-TaggedBootDevicesTest_v242-1414061902-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:17.693039 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:28:17.724676 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:17.725443 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:17.913231 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:17.913639 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:17.914358 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:17.914746 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:17.930575 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:28:17.935741 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for user 9e66f7b82e574fda9fc592d6ba3ed140 and project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:28:17.959914 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: abca4f7f-98d7-4052-9c1b-30ed25f48182] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:28:17.961111 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:17.961710 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:18.046788 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: abca4f7f-98d7-4052-9c1b-30ed25f48182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:28:18.048481 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:18.049540 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:18.344459 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:18.346018 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-393bbfdc-804c-45bc-8006-9e0ec90b2d04 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:21.673065 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:28:21.732209 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:21.734169 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:21.854720 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:21.855127 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:21.855849 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:21.856240 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:21.897029 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:28:21.905113 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for user 5778cfa0be07463b97e6a79469bbc5a2 and project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:28:21.921024 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: f6d2aa32-4b72-4d98-9147-38b6e415e37d] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:28:21.924589 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:21.924589 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:22.000993 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: f6d2aa32-4b72-4d98-9147-38b6e415e37d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:28:22.002444 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:22.003149 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:22.271338 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:22.271800 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-2da2c203-ef77-4ca4-bfba-e0cfa7212fc9 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:29.528047 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:28:29.607635 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:29.608393 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:29.782816 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:29.783758 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:29.784773 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:29.785358 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:29.842778 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Getting quotas for project f3d32eb74223457ba5f8ec0a6b597a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:28:29.855347 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Getting quotas for user b21339b035cc4e7cb56946e8bebfc624 and project f3d32eb74223457ba5f8ec0a6b597a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:28:29.878929 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] [instance: 3c6d168c-6ac3-47ab-9213-820f75c83cb4] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:28:29.880123 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:29.880731 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:29.949206 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] [instance: 3c6d168c-6ac3-47ab-9213-820f75c83cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:28:29.951285 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:29.951980 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:30.246006 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:30.250057 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77fffbf6-8710-410a-8649-1b725bfcd5dd tempest-SecurityGroupsTestJSON-1217370251 tempest-SecurityGroupsTestJSON-1217370251-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:33.289338 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:28:34.320148 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37198. Jul 08 08:28:42.716286 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:28:42.811511 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:42.814789 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:43.075697 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:43.076480 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:43.082805 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:43.083669 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:43.121974 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Getting quotas for project 962bcb62217245ae905244e4829fea44. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:28:43.128457 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Getting quotas for user 34a8bdc5573748ada28ac23681c00886 and project 962bcb62217245ae905244e4829fea44. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:28:43.141453 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] [instance: c5492edc-fe64-47ec-b52f-eea754c840a1] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:28:43.142630 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:43.143101 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:43.235285 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] [instance: c5492edc-fe64-47ec-b52f-eea754c840a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:28:43.236583 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:43.241339 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:43.542428 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:43.543302 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4a2a1f41-6b64-4b34-8b64-ae6f54d26c0b tempest-InstanceActionsNegativeTestJSON-1036118341 tempest-InstanceActionsNegativeTestJSON-1036118341-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:49.579970 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:28:49.615152 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:49.615768 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:49.869518 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:49.871402 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:49.876743 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:49.877257 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:49.926441 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Getting quotas for project 3883fb19a4a54c1294ee40a4c801a278. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:28:49.926441 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Getting quotas for user 1ae3609bb48c49c28236d10d8b1eb2dc and project 3883fb19a4a54c1294ee40a4c801a278. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:28:49.939533 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] [instance: 4d3d113a-b68e-464d-93da-0eec68fe208a] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:28:49.940727 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:49.941337 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:50.033817 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] [instance: 4d3d113a-b68e-464d-93da-0eec68fe208a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:28:50.035209 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:50.035689 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:50.311853 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:28:50.339894 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:50.341365 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:50.353692 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:50.354222 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1338759a-cde0-4e19-8b0e-6c135435e4d2 tempest-ServersNegativeTestMultiTenantJSON-370253969 tempest-ServersNegativeTestMultiTenantJSON-370253969-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:50.480289 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:50.481100 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:50.483276 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:50.484646 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:50.533394 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:28:50.545856 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Getting quotas for user 5778cfa0be07463b97e6a79469bbc5a2 and project d71d08a598bb4605a8e56d9e91993564. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:28:50.555839 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: 1105b44c-264f-4f59-86ff-26df1ec44532] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:28:50.557127 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:50.557625 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:50.625942 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] [instance: 1105b44c-264f-4f59-86ff-26df1ec44532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:28:50.630773 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:50.631451 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:28:50.885308 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:28:50.885918 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-38abef25-77db-49a2-a543-579964bb6329 tempest-ServerActionsTestJSON-430635495 tempest-ServerActionsTestJSON-430635495-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:09.433175 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:29:09.468548 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:09.468548 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:09.558920 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:09.559371 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:09.560115 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:09.560559 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:09.585922 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:29:09.592388 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for user 9e66f7b82e574fda9fc592d6ba3ed140 and project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:29:09.606420 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: 73bcf851-061d-4575-acc4-738862a5ee15] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:29:09.608180 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:09.609792 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:09.698111 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: 73bcf851-061d-4575-acc4-738862a5ee15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:29:09.700628 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:09.703150 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:09.947575 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:09.947918 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4c167fbc-5b89-4cf0-804e-499478ba4a6b tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:14.474686 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:29:14.520043 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:14.522946 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:14.638798 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:14.639563 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:14.641182 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:14.641787 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:14.678556 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:29:14.689973 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for user 9e66f7b82e574fda9fc592d6ba3ed140 and project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:29:14.716688 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: f615966d-b879-4c48-8ba8-d722f58fdb56] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:29:14.719403 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:14.722773 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:14.798334 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: f615966d-b879-4c48-8ba8-d722f58fdb56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:29:14.799899 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:14.800288 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:15.032480 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:15.033709 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dd734458-63ba-4365-865f-6cd3d76437a0 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:23.326541 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:29:23.348228 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:23.349033 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:23.599253 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:23.601607 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:23.602661 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:23.605584 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:23.646356 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Getting quotas for project ef9640d9338e4a88a8b1dbce764c439c. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:29:23.652970 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Getting quotas for user 83eae99a2b6442799c097846d4255162 and project ef9640d9338e4a88a8b1dbce764c439c. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:29:23.666388 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] [instance: bd969f32-f8fd-4a9e-932d-80aafd84a7d9] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:29:23.667595 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:23.667998 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:23.729240 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] [instance: bd969f32-f8fd-4a9e-932d-80aafd84a7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:29:23.730477 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:23.730882 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:24.009802 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:24.010223 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5e2de3d-bb27-4c7b-b12a-b9fef2395b3c tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:24.262157 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:29:24.386379 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:29:24.430056 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:24.431436 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:24.647436 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:24.647852 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:24.648626 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:24.649026 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:24.699898 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Getting quotas for project ef9640d9338e4a88a8b1dbce764c439c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:29:24.711735 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Getting quotas for user 83eae99a2b6442799c097846d4255162 and project ef9640d9338e4a88a8b1dbce764c439c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:29:24.745839 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] [instance: 4a7cfaf8-bbf8-4b59-b44b-a41e5a244030] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:29:24.748087 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:24.749698 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:24.833622 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] [instance: 4a7cfaf8-bbf8-4b59-b44b-a41e5a244030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:29:24.836136 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:24.837983 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:25.072017 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:25.072484 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-dfde6aa6-a9d3-40d3-a790-22c3028f4e79 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:25.291840 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38110. Jul 08 08:29:36.675480 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5223993f-7c27-4d78-a834-3d740bd58802 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method rebuild_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:29:36.678136 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5223993f-7c27-4d78-a834-3d740bd58802 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:36.678580 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5223993f-7c27-4d78-a834-3d740bd58802 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:36.776306 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5223993f-7c27-4d78-a834-3d740bd58802 tempest-ServerShowV247Test-476162277 tempest-ServerShowV247Test-476162277-project] [instance: 4a7cfaf8-bbf8-4b59-b44b-a41e5a244030] No migration record for the rebuild/evacuate request. {{(pid=82011) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Jul 08 08:29:50.245032 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:29:50.311157 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:50.311769 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:50.591067 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:50.591478 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:50.600122 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:50.600572 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:50.649401 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Getting quotas for project 48280e0e813b4a90b86b2d607d06f68e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:29:50.675337 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Getting quotas for user 311e90fed8e9442580954f8ee9f7fd3f and project 48280e0e813b4a90b86b2d607d06f68e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:29:50.723778 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] [instance: d2c416d6-ff15-4702-8011-fe0bb44f8d27] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:29:50.730368 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:50.731750 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:50.847492 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] [instance: d2c416d6-ff15-4702-8011-fe0bb44f8d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:29:50.849544 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:50.849945 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:51.100729 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:51.101420 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57186ab7-7f04-4ac7-86f4-351dc7501767 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:54.216691 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Took 1.50 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:29:54.259217 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:54.259632 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:54.545818 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:54.552794 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:54.553693 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:54.554247 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:54.579788 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Getting quotas for project 5687776d567d4602989725dd3fea129e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:29:54.587151 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Getting quotas for user 4dfa17038b9e4297b03878b44c430259 and project 5687776d567d4602989725dd3fea129e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:29:54.618943 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] [instance: 73348372-ea40-4862-9e0d-c019fa4aa69c] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:29:54.620214 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:54.621842 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:54.699895 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] [instance: 73348372-ea40-4862-9e0d-c019fa4aa69c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:29:54.701099 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:54.701701 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:29:54.980191 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:29:54.980877 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-b8e2cf45-77af-45a9-8ade-9e2ba2e80aa2 tempest-ServerAddressesNegativeTestJSON-1523683153 tempest-ServerAddressesNegativeTestJSON-1523683153-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:00.372666 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:30:00.416481 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:00.419624 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:00.571249 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:00.572311 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:00.573292 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:00.574385 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:00.600677 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:30:00.609028 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for user 9e66f7b82e574fda9fc592d6ba3ed140 and project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:30:00.621029 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: cf6dd98b-fa5e-4896-8cc3-4a6f1374303f] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:30:00.622643 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:00.623305 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:00.694688 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: cf6dd98b-fa5e-4896-8cc3-4a6f1374303f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:30:00.698495 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:00.701010 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:00.928859 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:00.929267 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7ed2eb1e-ad02-4e67-8c53-9f5f7d236851 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:30.226021 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:30:30.272657 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:30.276068 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:30.527031 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:30.527447 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:30.528178 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:30.528607 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:30.554572 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Getting quotas for project 48280e0e813b4a90b86b2d607d06f68e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:30:30.572084 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Getting quotas for user 311e90fed8e9442580954f8ee9f7fd3f and project 48280e0e813b4a90b86b2d607d06f68e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:30:30.577264 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] [instance: 6d3a9f18-e265-4b8d-b5cc-6a8907cbde67] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:30:30.578194 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:30.578643 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:30.635711 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] [instance: 6d3a9f18-e265-4b8d-b5cc-6a8907cbde67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:30:30.642634 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:30.642634 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:30.922187 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:30.922778 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86ef516b-9071-4ef3-b33f-adb026cd3d02 tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:39.374091 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:30:39.399453 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:39.399964 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:39.706453 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:39.707042 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:39.710368 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:39.710368 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:39.747189 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:30:39.760220 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for user 080f1a0b70074160a4c6a9b96627ce1d and project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:30:39.779730 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 30ddaedc-28aa-4263-8f0e-686563423cd1] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:30:39.780919 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:39.781499 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:39.862946 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 30ddaedc-28aa-4263-8f0e-686563423cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:30:39.864646 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:39.865211 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:40.157147 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:40.157896 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-980d2d3b-a244-47b8-a84f-dbb9d28e228e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:57.526657 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:30:57.569983 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:57.570404 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:57.839538 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:57.839972 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:57.840721 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:57.841238 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:57.882289 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Getting quotas for project 0bf76d8fd4524f0f8388d846e8f2734a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:30:57.882289 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Getting quotas for user 33c153c4235a4407a557f9983aa08658 and project 0bf76d8fd4524f0f8388d846e8f2734a. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:30:57.893982 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] [instance: 20cdf750-29e9-4636-9a6e-fc6891e233d3] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:30:57.895353 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:57.895865 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:57.995306 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] [instance: 20cdf750-29e9-4636-9a6e-fc6891e233d3] block_device_mapping [BlockDeviceMapping(attachment_id=8825596e-3dcb-4a01-b2e1-151f1b2e8791,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f34dc3c2-634b-4471-b2df-e2ff33ad151c',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=8c78b1d5-53df-4dd9-b3f6-f30a204739f8,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='90407b24-03a6-424b-bc1a-68bc6a3e692d',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=38cff320-dd4a-46d4-b2cb-4013b57b58ad,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f3b01dd-c652-4046-af9c-ccdae5ebf7ea',volume_size=1,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:30:57.997588 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:57.998321 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:58.118993 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:58.118993 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:58.281770 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:58.282369 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:58.536360 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:58.536940 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-26286653-04a3-4d7d-8a71-3841d3fde010 tempest-TaggedBootDevicesTest-397325847 tempest-TaggedBootDevicesTest-397325847-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:58.763191 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:30:58.797899 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:58.798298 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:58.993297 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:58.993701 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:58.994432 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:59.000239 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:59.029035 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Getting quotas for project 48280e0e813b4a90b86b2d607d06f68e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:30:59.034438 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Getting quotas for user 311e90fed8e9442580954f8ee9f7fd3f and project 48280e0e813b4a90b86b2d607d06f68e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:30:59.045479 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] [instance: 4a34836a-1a1c-45d4-8dca-f05c5a9e562e] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:30:59.046427 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:59.046855 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:59.242884 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] [instance: 4a34836a-1a1c-45d4-8dca-f05c5a9e562e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:30:59.242884 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:59.244328 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:30:59.583315 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:30:59.583688 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8628c060-31a1-4cc1-9921-c96e96842c5f tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:04.856883 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:31:04.947355 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:04.954219 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:05.107001 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:05.107756 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:05.110098 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:05.110098 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:05.128497 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:31:05.133820 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for user 080f1a0b70074160a4c6a9b96627ce1d and project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:31:05.148223 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: bf790624-b102-4d60-954a-5cf477717b47] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:31:05.149390 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:05.149956 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:05.270564 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: bf790624-b102-4d60-954a-5cf477717b47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:31:05.283268 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:05.283268 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:05.556455 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:05.556932 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:05.920312 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:05.921535 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70978ab5-6800-45f6-9a02-77e13e39655c tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:12.790426 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:31:12.871965 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:12.874537 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:13.186398 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:13.197523 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:13.198721 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:13.199293 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:13.258095 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:31:13.273454 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for user 080f1a0b70074160a4c6a9b96627ce1d and project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:31:13.295741 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: c3ddb944-8314-402e-8213-21c857b557d4] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:31:13.297311 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:13.297916 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:13.379210 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: c3ddb944-8314-402e-8213-21c857b557d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:31:13.382427 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:13.383283 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:13.743198 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:13.744054 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-8d5300da-4da5-42de-ae82-44de70c05436 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:17.391005 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:31:34.318014 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:31:35.341114 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 40438. Jul 08 08:31:48.630243 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-77b772d4-176c-4607-9728-874919472dc3 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method unshelve_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:31:48.638514 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77b772d4-176c-4607-9728-874919472dc3 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:48.638514 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-77b772d4-176c-4607-9728-874919472dc3 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:49.798270 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-77b772d4-176c-4607-9728-874919472dc3 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] [instance: 3780a524-5f0c-482f-83d8-808e96bdd996] Requesting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) during scheduling {{(pid=82011) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Jul 08 08:31:50.954945 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-77b772d4-176c-4607-9728-874919472dc3 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Took 1.15 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:31:54.532054 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:31:54.614281 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:54.620816 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:54.710938 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:31:54.773913 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:54.774399 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:54.891841 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:54.892446 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:54.892985 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:54.893521 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:54.958131 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:31:54.963899 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for user 080f1a0b70074160a4c6a9b96627ce1d and project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:31:54.991527 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 5eacfdae-1aea-4577-969b-dda1c7b8d333] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:31:54.992657 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:54.993065 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:55.008786 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:55.011883 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:55.012945 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:55.013401 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:55.053526 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Getting quotas for project 48280e0e813b4a90b86b2d607d06f68e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:31:55.066028 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Getting quotas for user 311e90fed8e9442580954f8ee9f7fd3f and project 48280e0e813b4a90b86b2d607d06f68e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:31:55.103145 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] [instance: 2692212d-51c0-4661-86b2-1ede73d284cd] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:31:55.103145 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:55.103145 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:55.127780 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 5eacfdae-1aea-4577-969b-dda1c7b8d333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:31:55.132881 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:55.132881 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:55.274481 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] [instance: 2692212d-51c0-4661-86b2-1ede73d284cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:31:55.276655 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:55.277274 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:55.519601 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:55.520220 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-86380fb7-28fe-4288-87cc-b635f5353c11 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:31:55.607197 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:31:55.607863 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c62e3314-f60c-428f-96ad-44952aebd1af tempest-AttachVolumeNegativeTest-729552572 tempest-AttachVolumeNegativeTest-729552572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:09.572644 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:32:09.611662 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:09.612165 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:09.751402 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:09.752555 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:09.754769 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:09.755177 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:09.774626 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:32:09.782286 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for user 9e66f7b82e574fda9fc592d6ba3ed140 and project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:32:09.790352 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: 651e8404-999e-4fa6-a11f-9d9885cdb4ca] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:32:09.791295 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:09.791703 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:09.849584 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: 651e8404-999e-4fa6-a11f-9d9885cdb4ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:32:09.850889 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:09.851290 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:10.119524 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:10.120386 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-4c932f68-0695-49f8-9a7e-21e7cc454243 tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:11.719206 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:32:11.781936 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:11.782391 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:12.046958 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:12.047360 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:12.048295 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:12.048867 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:12.074256 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Getting quotas for project 22ccb767f5d442e19652cf5564a32983. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:32:12.087702 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Getting quotas for user 229472766d3b4714a06b6d9d40136b6e and project 22ccb767f5d442e19652cf5564a32983. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:32:12.106988 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] [instance: 3b2e2bf4-a2ff-477c-8336-515ad010767e] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:32:12.108383 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:12.108383 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:12.223328 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] [instance: 3b2e2bf4-a2ff-477c-8336-515ad010767e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:32:12.224617 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:12.225027 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:12.662401 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:12.662401 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-192a43c9-0107-4399-a77f-7b9e462f7b62 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:25.293363 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:32:26.329197 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 41324. Jul 08 08:32:42.412817 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:32:42.434547 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:42.434910 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:42.531646 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:42.532143 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:42.532964 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:42.533532 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:42.551169 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:32:42.555925 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for user 080f1a0b70074160a4c6a9b96627ce1d and project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:32:42.569878 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 4bc17e06-0712-4eaf-9ede-c30dbc381d13] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:32:42.570937 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:42.571404 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:42.640358 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 4bc17e06-0712-4eaf-9ede-c30dbc381d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:32:42.641938 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:42.642339 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:32:42.970678 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:32:42.971290 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0a0805cb-8fca-4bab-b8fe-42f273304b1b tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:05.067376 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:33:05.096142 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:05.096142 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:05.247271 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:05.247850 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:05.249473 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:05.250188 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:05.320539 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:33:05.329992 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for user 080f1a0b70074160a4c6a9b96627ce1d and project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:33:05.350507 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 24006493-3498-4967-bd14-d70f5115361c] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:33:05.353078 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:05.353488 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:05.408048 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 24006493-3498-4967-bd14-d70f5115361c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:33:05.413831 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:05.413831 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:05.650788 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:05.650788 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-eb692b33-c04d-4ba9-bac8-f41bcbaeb07d tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.003409 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:33:40.031295 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.031846 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.184305 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.184656 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.185683 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.185683 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.202631 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:33:40.204029 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:33:40.208780 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for user 080f1a0b70074160a4c6a9b96627ce1d and project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:33:40.222863 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 0e10bda3-7f35-436d-adbd-6fe38d353e25] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:33:40.223834 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.224240 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.225596 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.226006 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.335482 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 0e10bda3-7f35-436d-adbd-6fe38d353e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:33:40.336884 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.337287 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.401802 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.402207 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.402920 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.403315 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.419896 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:33:40.424416 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Getting quotas for user 9e66f7b82e574fda9fc592d6ba3ed140 and project 71a540565c004bd2a46941143d627798. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:33:40.435376 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: 00918827-afa8-4b5d-8be3-fa9eacd6dcdd] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:33:40.436437 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.436908 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.539314 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] [instance: 00918827-afa8-4b5d-8be3-fa9eacd6dcdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:33:40.543713 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.543713 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.670536 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.671135 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-82b2e52d-a577-4052-bd3f-9b56edf92179 tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:33:40.813429 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:33:40.813834 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2cde8b0b-9a96-443a-9885-a64d52035f0c tempest-DeleteServersTestJSON-313571800 tempest-DeleteServersTestJSON-313571800-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:09.311545 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:34:09.333650 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:09.335103 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:09.516205 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:09.520398 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:09.520398 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:09.520398 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:09.537201 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:34:09.542237 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Getting quotas for user 080f1a0b70074160a4c6a9b96627ce1d and project 7750aa141e9044649c3e047b1e8b07f5. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:34:09.554142 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 2b1bf933-da89-4f72-a223-5402a27001a0] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:34:09.555482 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:09.556131 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:09.622988 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] [instance: 2b1bf933-da89-4f72-a223-5402a27001a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:34:09.627269 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:09.627269 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:09.869837 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:09.870474 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a41b646e-b7ca-4a9c-bf82-154232de808e tempest-ServersTestJSON-1627500432 tempest-ServersTestJSON-1627500432-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:15.768578 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:34:30.152055 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:30.152680 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:30.863926 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:34:30.892011 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:30.892876 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:31.150671 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:31.151351 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:31.152439 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:31.153580 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:31.184824 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Getting quotas for project e9f08098ed334241bd1f7bfd2dc32221. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:34:31.190551 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Getting quotas for user 2e3ef52f71c64b4094b54fb2df6cb3fd and project e9f08098ed334241bd1f7bfd2dc32221. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:34:31.203356 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] [instance: 63dba90f-4444-4696-8e73-6a63645ca3e9] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:34:31.203991 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:31.204275 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:31.313977 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] [instance: 63dba90f-4444-4696-8e73-6a63645ca3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:34:31.315197 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:31.315596 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:31.720087 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:31.720593 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-69b9acee-8271-486a-8b44-f07be7fdc00e tempest-ServerGroupTestJSON-397298998 tempest-ServerGroupTestJSON-397298998-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:33.536437 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:34:33.570070 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:33.570308 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:33.767304 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:33.767710 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:33.768472 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:33.768868 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:33.787060 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Getting quotas for project 3cfe1dcca1e74946b3ec6579e5458da7. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:34:33.792946 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Getting quotas for user fdd8aa45a0bf488e9bed6f6471c6c378 and project 3cfe1dcca1e74946b3ec6579e5458da7. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:34:33.805003 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] [instance: 19c43e50-b8ab-480b-ba55-e6a6ce096ce0] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:34:33.810045 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:33.810045 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:33.906284 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] [instance: 19c43e50-b8ab-480b-ba55-e6a6ce096ce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:34:33.906284 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:33.906284 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:34.252762 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:34:34.253172 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-0d720496-ce1a-4a53-a707-69bb5cf54893 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:34:35.337410 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:34:36.362527 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 44240. Jul 08 08:34:37.418814 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:35:07.848283 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:35:07.877110 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:07.877575 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:08.148004 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:08.149197 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:08.153412 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:08.154878 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:08.184591 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Getting quotas for project 05ad2966b4234207a132d41cd3c63cc7. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:35:08.189698 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Getting quotas for user 3ef76dff86794de2ac7aa1fda1ef74a1 and project 05ad2966b4234207a132d41cd3c63cc7. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:35:08.202904 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] [instance: a28bddc6-0016-4b3f-b09b-e9b2795df8aa] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:35:08.204522 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:08.205265 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:08.281025 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] [instance: a28bddc6-0016-4b3f-b09b-e9b2795df8aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:35:08.281025 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:08.281025 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:08.620601 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:08.621597 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a6509312-c762-41c4-9a7c-84411f88c249 tempest-ServerMetadataNegativeTestJSON-894428283 tempest-ServerMetadataNegativeTestJSON-894428283-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:21.586042 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:35:21.611457 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:21.611868 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:21.852224 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:21.852724 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:21.853511 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:21.853975 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:21.871126 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Getting quotas for project a6084d9ab8e546c8a9376914a14d1b1d. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:35:21.875858 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Getting quotas for user 4c50c054c4bb4457aecaf1c1ccec4e25 and project a6084d9ab8e546c8a9376914a14d1b1d. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:35:21.886410 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] [instance: 9a7000b8-5be7-431e-bb0e-d562e683b33a] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:35:21.889866 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:21.889866 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:21.980962 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] [instance: 9a7000b8-5be7-431e-bb0e-d562e683b33a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:35:21.982602 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:21.984639 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:22.290016 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:22.290448 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3cf12f36-dfc8-4f30-8eef-540b0b57c6ec tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:26.328905 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:35:27.345185 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45534. Jul 08 08:35:30.096169 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2d6cb776-53f1-4f7a-8d88-fb03bc423727 tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method rebuild_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:35:30.096793 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2d6cb776-53f1-4f7a-8d88-fb03bc423727 tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:30.097716 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2d6cb776-53f1-4f7a-8d88-fb03bc423727 tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:30.206479 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2d6cb776-53f1-4f7a-8d88-fb03bc423727 tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] [instance: 9a7000b8-5be7-431e-bb0e-d562e683b33a] No migration record for the rebuild/evacuate request. {{(pid=82011) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Jul 08 08:35:30.337597 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_db.api [None req-2d6cb776-53f1-4f7a-8d88-fb03bc423727 tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Jul 08 08:35:30.337597 chdv-799894-1 nova-conductor[82011]: [SQL: UPDATE instance_actions SET updated_at=%(updated_at)s WHERE instance_actions.id = %(instance_actions_id)s] Jul 08 08:35:30.337597 chdv-799894-1 nova-conductor[82011]: [parameters: {'updated_at': datetime.datetime(2021, 7, 8, 8, 35, 30, 237770), 'instance_actions_id': 306}] Jul 08 08:35:30.337597 chdv-799894-1 nova-conductor[82011]: (Background on this error at: http://sqlalche.me/e/13/e3q8) {{(pid=82011) _is_exception_expected /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:184}} Jul 08 08:35:30.338046 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_db.api [None req-2d6cb776-53f1-4f7a-8d88-fb03bc423727 tempest-ServerShowV254Test-1613359572 tempest-ServerShowV254Test-1613359572-project] Performing DB retry for function nova.db.sqlalchemy.api.action_event_finish {{(pid=82011) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jul 08 08:35:42.110534 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:35:42.134316 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:42.140392 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:42.453399 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:42.454031 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:42.457801 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:42.458513 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:42.511922 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Getting quotas for project 46bdaed358e147e59c3c5fd0f4881bc2. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:35:42.528609 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Getting quotas for user ad7ca2ad5b49458b9c00f3f979dd4ae2 and project 46bdaed358e147e59c3c5fd0f4881bc2. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:35:42.563227 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] [instance: 317b210b-d93c-471e-8ee1-b0ec2fde3eb8] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:35:42.571275 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:42.571698 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:42.666851 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] [instance: 317b210b-d93c-471e-8ee1-b0ec2fde3eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:35:42.668752 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:42.669326 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:35:42.951626 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:35:42.952398 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e04ae1c9-b498-4402-ab77-2d176774bdab tempest-ServerPasswordTestJSON-1358380716 tempest-ServerPasswordTestJSON-1358380716-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:36:12.988033 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:36:13.010291 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:36:13.010696 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:36:13.207622 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:36:13.208893 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:36:13.209628 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:36:13.210370 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:36:13.228421 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Getting quotas for project 30f883c05e8740d9943a8f9eb99260e4. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:36:13.234902 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Getting quotas for user 2bd102cb196542d4b1f03084a7b02ad9 and project 30f883c05e8740d9943a8f9eb99260e4. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:36:13.248685 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] [instance: efdb6995-ee10-4774-bf85-7e4000b7d775] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:36:13.251072 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:36:13.251072 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:36:13.510160 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] [instance: efdb6995-ee10-4774-bf85-7e4000b7d775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:36:13.511501 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:36:13.511973 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:36:13.782608 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:36:13.783794 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f959c7b4-bd50-4bda-b260-a4983fdbb52e tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:36:20.449515 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-853735c4-b5e5-4651-82d8-1006c8bbe280 tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method rebuild_instance {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:36:20.450090 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-853735c4-b5e5-4651-82d8-1006c8bbe280 tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:36:20.450384 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-853735c4-b5e5-4651-82d8-1006c8bbe280 tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:36:20.521625 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-853735c4-b5e5-4651-82d8-1006c8bbe280 tempest-ServerShowV257Test-788929802 tempest-ServerShowV257Test-788929802-project] [instance: efdb6995-ee10-4774-bf85-7e4000b7d775] No migration record for the rebuild/evacuate request. {{(pid=82010) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Jul 08 08:37:36.358616 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:37:37.384093 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49216. Jul 08 08:38:11.344180 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:38:12.367449 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49954. Jul 08 08:38:14.942215 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:38:15.961984 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50006. Jul 08 08:38:27.354096 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:38:28.416557 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50220. Jul 08 08:38:41.577653 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:38:41.671714 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:38:42.614579 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50576. Jul 08 08:38:42.703224 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50578. Jul 08 08:38:51.417725 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:38:53.553496 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ba1f1fcf-5c8e-4923-9380-0f7cfc613333 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method unshelve_instance {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:38:53.554129 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ba1f1fcf-5c8e-4923-9380-0f7cfc613333 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:38:53.554366 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ba1f1fcf-5c8e-4923-9380-0f7cfc613333 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:38:54.297175 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ba1f1fcf-5c8e-4923-9380-0f7cfc613333 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] [instance: 19c43e50-b8ab-480b-ba55-e6a6ce096ce0] Requesting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) during scheduling {{(pid=82010) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Jul 08 08:38:54.492013 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:38:54.524044 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:38:54.524638 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:38:54.649039 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:38:54.650237 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:38:54.651931 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:38:54.652555 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:38:54.684440 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Getting quotas for project 22ccb767f5d442e19652cf5564a32983. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:38:54.697478 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Getting quotas for user 229472766d3b4714a06b6d9d40136b6e and project 22ccb767f5d442e19652cf5564a32983. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:38:54.711854 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] [instance: fbd1ebba-c214-43c9-add6-3f74d36078d5] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:38:54.714022 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:38:54.719339 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:38:54.792575 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] [instance: fbd1ebba-c214-43c9-add6-3f74d36078d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:38:54.794393 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:38:54.795004 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:38:54.994629 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:38:55.046239 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:38:55.046645 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acf468f4-2bac-4dad-8ec4-36bcd183d5c9 tempest-AttachVolumeTestJSON-350149923 tempest-AttachVolumeTestJSON-350149923-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:38:55.981221 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ba1f1fcf-5c8e-4923-9380-0f7cfc613333 tempest-AttachVolumeShelveTestJSON-1735123835 tempest-AttachVolumeShelveTestJSON-1735123835-project] Took 1.67 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:38:56.930748 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:39:37.447234 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:39:39.811181 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:39:39.847997 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:39:39.847997 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:39:40.224818 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:39:40.225240 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:39:40.226078 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:39:40.226462 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:39:40.259413 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Getting quotas for project e266f006d98940a0a699d5caadb2e016. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:39:40.266568 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Getting quotas for user 4045e2ee2ad44815b10c8f3672f68522 and project e266f006d98940a0a699d5caadb2e016. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:39:40.294756 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] [instance: 582ec3bd-7136-452b-a5be-e028f8c95cde] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:39:40.294756 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:39:40.297792 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:39:40.421547 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] [instance: 582ec3bd-7136-452b-a5be-e028f8c95cde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:39:40.426352 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:39:40.426352 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:39:40.821893 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:39:40.822984 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-ae1d73d7-41bf-4728-a3cf-c1bf0e2c2565 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:35.000857 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:40:35.029442 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:35.029842 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:35.163084 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:35.163514 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:35.164257 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:35.164675 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:35.183702 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Getting quotas for project e266f006d98940a0a699d5caadb2e016. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:40:35.193625 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Getting quotas for user 4045e2ee2ad44815b10c8f3672f68522 and project e266f006d98940a0a699d5caadb2e016. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:40:35.201427 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] [instance: cef8ac9a-c883-4bd6-b279-dd0c9e2b6070] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:40:35.202678 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:35.203083 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:35.274013 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] [instance: cef8ac9a-c883-4bd6-b279-dd0c9e2b6070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:40:35.274013 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:35.274013 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:35.623677 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:35.627825 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b4cedd53-f814-4bf1-8ed5-546b3fa44932 tempest-ServerRescueTestJSON-716777333 tempest-ServerRescueTestJSON-716777333-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:37.382639 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:40:38.404198 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53382. Jul 08 08:40:46.451745 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:40:46.488681 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:46.489726 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:46.792050 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:46.792478 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:46.795186 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:46.795586 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:46.843975 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Getting quotas for project fbeb06722abd422aa08492a847fb22e9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:40:46.849590 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Getting quotas for user aefdd36590a54236b2866ff656ed1ef7 and project fbeb06722abd422aa08492a847fb22e9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:40:46.861561 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] [instance: 4f204b5f-11a7-4ce6-8c20-0c6d3affeff1] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:40:46.863187 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:46.863588 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:46.942331 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] [instance: 4f204b5f-11a7-4ce6-8c20-0c6d3affeff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:40:46.943613 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:46.944196 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:47.234475 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:40:47.235351 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb03-448d-4abe-b11c-e74e62996634 tempest-VolumesActionsTest-462980901 tempest-VolumesActionsTest-462980901-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:40:55.805128 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:41:28.407447 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:41:29.447769 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54402. Jul 08 08:42:12.787488 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:42:12.865620 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:12.866173 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:13.093763 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:13.093763 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:13.093763 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:13.093763 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:13.151754 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Getting quotas for project 6c71961a99ab499da8b68e500959578c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:42:13.162415 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Getting quotas for user faeb64de075e4776a24d4cab5e53a72b and project 6c71961a99ab499da8b68e500959578c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:42:13.188221 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] [instance: ccd12d92-be0f-4e2c-9218-1cbf9121987e] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:42:13.189203 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:13.189605 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:13.275277 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] [instance: ccd12d92-be0f-4e2c-9218-1cbf9121987e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:42:13.276560 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:13.276968 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:13.644408 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:13.645186 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b10f2a70-0885-45d6-8a02-40e31935c1bc tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:18.001461 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:42:18.054078 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:18.054771 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:18.289428 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:18.290439 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:18.291467 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:18.292075 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:18.319008 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Getting quotas for project e772c3f2101a46d686f7b6cb4ba32954. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:42:18.327192 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Getting quotas for user 695e6d598bfb4c6e9f2aad271dff1341 and project e772c3f2101a46d686f7b6cb4ba32954. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:42:18.342689 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] [instance: 5ee6c644-82dc-45af-94fe-0d0ee68cdaaf] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:42:18.344131 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:18.344944 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:18.523686 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] [instance: 5ee6c644-82dc-45af-94fe-0d0ee68cdaaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:42:18.524934 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:18.525574 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:18.838390 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:18.840569 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-70e6477c-9cd4-45a6-9fc6-649870b07928 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:33.625874 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:42:33.701674 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:33.702327 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:33.860679 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:33.860982 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:33.861766 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:33.862343 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:33.890359 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Getting quotas for project 6c71961a99ab499da8b68e500959578c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:42:33.890359 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Getting quotas for user faeb64de075e4776a24d4cab5e53a72b and project 6c71961a99ab499da8b68e500959578c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:42:33.904290 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] [instance: c5547c4c-bb5a-4485-a509-55271135d14d] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:42:33.905612 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:33.906100 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:33.995933 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] [instance: c5547c4c-bb5a-4485-a509-55271135d14d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:42:33.997458 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:33.997861 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:34.405856 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:34.407037 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-499b0db5-6025-4686-9af9-84394ba9a8df tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:35.587326 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-d438750c-f33e-4670-b97a-b4f91d9da748 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method rebuild_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:42:35.588422 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-d438750c-f33e-4670-b97a-b4f91d9da748 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:42:35.589121 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-d438750c-f33e-4670-b97a-b4f91d9da748 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:42:35.726035 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-d438750c-f33e-4670-b97a-b4f91d9da748 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] [instance: 5ee6c644-82dc-45af-94fe-0d0ee68cdaaf] No migration record for the rebuild/evacuate request. {{(pid=82011) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Jul 08 08:42:57.471078 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:43:04.850630 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:43:04.908509 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:04.908764 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:05.197724 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:05.199383 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:05.201411 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:05.201791 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:05.232582 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Getting quotas for project 932b4b70601e4630aa6d3c7d0c66632c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:43:05.241966 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Getting quotas for user 2d1c7a1b5c4248fa935f456fd9777107 and project 932b4b70601e4630aa6d3c7d0c66632c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:43:05.267301 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] [instance: 1ceedc1f-57a1-430b-abdf-9a5b5a94018f] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:43:05.267301 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:05.267301 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:05.381035 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] [instance: 1ceedc1f-57a1-430b-abdf-9a5b5a94018f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:43:05.382277 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:05.383034 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:05.661798 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:05.662144 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-f1c270e2-af13-4256-88ce-fca8455746a8 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:25.181839 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:43:25.232792 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:25.235823 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:25.374331 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:25.374738 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:25.375443 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:25.375828 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:25.396623 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Getting quotas for project e772c3f2101a46d686f7b6cb4ba32954. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:43:25.401537 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Getting quotas for user 695e6d598bfb4c6e9f2aad271dff1341 and project e772c3f2101a46d686f7b6cb4ba32954. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:43:25.416773 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] [instance: 8bd97799-9b37-44a9-ab9d-258c479cc90c] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:43:25.418105 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:25.418913 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:25.601173 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] [instance: 8bd97799-9b37-44a9-ab9d-258c479cc90c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:43:25.601173 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:25.601173 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:26.111065 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:26.111544 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6db24983-7e3b-4c16-b0dd-61ceb5172d14 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:38.405445 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:43:39.437713 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 57510. Jul 08 08:43:40.939568 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:43:40.976258 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:40.976675 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:41.174245 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:41.174999 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:41.175808 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:41.176269 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:41.197253 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Getting quotas for project 932b4b70601e4630aa6d3c7d0c66632c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:43:41.202848 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Getting quotas for user 2d1c7a1b5c4248fa935f456fd9777107 and project 932b4b70601e4630aa6d3c7d0c66632c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:43:41.216170 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] [instance: 135b2df7-6a4f-48c7-b222-4e7d67265385] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:43:41.217339 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:41.217821 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:41.322549 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] [instance: 135b2df7-6a4f-48c7-b222-4e7d67265385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:43:41.324325 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:41.325843 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:41.620068 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:41.620493 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-ab920cbe-931c-4ea1-ac0c-109ace711395 tempest-VolumesActionsTest-1615411182 tempest-VolumesActionsTest-1615411182-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:52.100543 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f5027a81-3709-4d59-9058-be8d6a226022 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method rebuild_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:43:52.102213 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f5027a81-3709-4d59-9058-be8d6a226022 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:43:52.102827 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f5027a81-3709-4d59-9058-be8d6a226022 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:43:52.217466 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f5027a81-3709-4d59-9058-be8d6a226022 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] [instance: 8bd97799-9b37-44a9-ab9d-258c479cc90c] No migration record for the rebuild/evacuate request. {{(pid=82011) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Jul 08 08:44:29.452090 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:44:30.504106 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58574. Jul 08 08:44:44.736326 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Took 1.09 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:44:44.825896 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:44:44.829925 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:44:45.123314 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:44:45.123717 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:44:45.124614 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:44:45.128362 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:44:45.161801 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Getting quotas for project e772c3f2101a46d686f7b6cb4ba32954. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:44:45.167859 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Getting quotas for user 695e6d598bfb4c6e9f2aad271dff1341 and project e772c3f2101a46d686f7b6cb4ba32954. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:44:45.186147 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] [instance: 671d1d21-6a64-4931-ad1a-06f841289c9c] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:44:45.187516 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:44:45.188443 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:44:45.322078 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] [instance: 671d1d21-6a64-4931-ad1a-06f841289c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:44:45.323476 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:44:45.323878 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:44:45.686974 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:44:45.687711 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5539c60f-4b50-4b69-ac9e-e4a8402977e7 tempest-ServerDiskConfigTestJSON-2117822464 tempest-ServerDiskConfigTestJSON-2117822464-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:12.892637 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-0654b68c-071b-4a93-a839-8530b95e8779 tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method unshelve_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:45:12.896781 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0654b68c-071b-4a93-a839-8530b95e8779 tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:12.900141 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-0654b68c-071b-4a93-a839-8530b95e8779 tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:13.952874 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-0654b68c-071b-4a93-a839-8530b95e8779 tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] [instance: ccd12d92-be0f-4e2c-9218-1cbf9121987e] Requesting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) during scheduling {{(pid=82011) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Jul 08 08:45:14.725121 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-0654b68c-071b-4a93-a839-8530b95e8779 tempest-ServersNegativeTestJSON-143327066 tempest-ServersNegativeTestJSON-143327066-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:45:39.572313 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Took 1.83 seconds to select destinations for 3 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:45:39.672743 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:39.673285 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:39.970579 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:39.971071 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:40.144131 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:40.150371 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:40.375263 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:40.375893 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:40.380303 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:40.387617 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:40.456469 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Getting quotas for project 7c531610c7e4443693d01ca20aacc7db. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:45:40.490803 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Getting quotas for user 38fefb4d8ac64273b3bfc2238975a5de and project 7c531610c7e4443693d01ca20aacc7db. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:45:40.522429 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] [instance: b278b924-7d5a-4f94-a85d-d2cd5a7ef519] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:45:40.524252 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:40.525129 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:40.613446 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] [instance: b278b924-7d5a-4f94-a85d-d2cd5a7ef519] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:45:40.616796 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:40.618401 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:40.934690 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:40.936826 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:40.973446 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] [instance: 90ea269e-1786-45bb-8f9c-4dd17cf9d16d] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:45:40.977848 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:41.013018 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:41.105726 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] [instance: 90ea269e-1786-45bb-8f9c-4dd17cf9d16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:45:41.105726 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:41.105726 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:41.625653 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:41.626720 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:41.661962 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] [instance: 18d1502a-1282-48fa-806b-9b50173350be] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:45:41.668850 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:41.669607 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:41.766662 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] [instance: 18d1502a-1282-48fa-806b-9b50173350be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:45:41.768832 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:41.769385 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:42.151292 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:45:42.151780 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-578e2cdc-f233-47bd-9152-e68bef3c548c tempest-ListServersNegativeTestJSON-2040070877 tempest-ListServersNegativeTestJSON-2040070877-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:45:55.837661 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:46:17.493437 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:46:39.436013 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:46:40.456941 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33938. Jul 08 08:46:56.574165 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:46:56.606981 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:46:56.610546 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:46:56.851977 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:46:56.852530 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:46:56.853635 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:46:56.854285 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:46:56.886679 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Getting quotas for project 616b0d54c9ce4daebe5923aef20642e1. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:46:56.892117 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Getting quotas for user 7d3f64c2e94241e287b67070b2b5405e and project 616b0d54c9ce4daebe5923aef20642e1. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:46:56.904589 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] [instance: 290cfecb-3970-45c9-97e8-e04fea3da7a8] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:46:56.905536 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:46:56.906104 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:46:56.984761 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] [instance: 290cfecb-3970-45c9-97e8-e04fea3da7a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:46:56.986339 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:46:56.987194 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:46:57.241369 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:46:57.242956 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-addfa5b4-fdf5-4691-a186-34f92c929cc5 tempest-ServerTagsTestJSON-178887273 tempest-ServerTagsTestJSON-178887273-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:47:30.493194 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:47:31.518440 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35304. Jul 08 08:47:38.092188 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:47:38.123336 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:47:38.123823 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:47:38.421022 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:47:38.423381 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:47:38.429965 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:47:38.430378 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:47:38.478165 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Getting quotas for project 33c331c367704d39bc80ab6e956404e7. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:47:38.488728 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Getting quotas for user 91e4109c898b41418f8c2580969c8144 and project 33c331c367704d39bc80ab6e956404e7. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:47:38.516853 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] [instance: b55a23e9-a036-4539-b6d9-65c7e62366e7] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:47:38.516853 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:47:38.516853 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:47:38.593043 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] [instance: b55a23e9-a036-4539-b6d9-65c7e62366e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:47:38.595536 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:47:38.596421 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:47:38.932657 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:47:38.932751 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b6586af0-d1a0-4c7d-b6ad-ec4bd3baff68 tempest-VolumesNegativeTest-1731303060 tempest-VolumesNegativeTest-1731303060-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:48:55.651718 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:48:55.674585 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:48:55.675081 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:48:56.010459 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:48:56.010459 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:48:56.010459 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:48:56.010459 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:48:56.026448 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Getting quotas for project 989ced0b00514c5d9a9fa8c170380175. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:48:56.061362 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Getting quotas for user 3ccfc8942869438c98c0854629827531 and project 989ced0b00514c5d9a9fa8c170380175. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:48:56.088292 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] [instance: 11109832-4cd3-4451-88c9-152fe8e01e58] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:48:56.088292 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:48:56.088292 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:48:56.168735 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] [instance: 11109832-4cd3-4451-88c9-152fe8e01e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:48:56.168735 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:48:56.168735 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:48:56.877777 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:48:56.877777 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-9aaf6a2c-fa1a-4ebc-ad41-fda2bf4f0ba1 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:49:15.865605 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:49:37.541195 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:49:40.456917 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:49:41.504913 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 39074. Jul 08 08:49:42.622169 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:49:43.651231 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 39116. Jul 08 08:49:55.759321 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Took 1.21 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:49:55.835358 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:49:55.835860 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:49:56.257060 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:49:56.257463 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:49:56.259058 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:49:56.259490 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:49:56.286592 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Getting quotas for project fe77772e79b84a6da98687e4b4ae6718. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:49:56.307092 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Getting quotas for user 209e00c029c04ee59033efaffa2e4052 and project fe77772e79b84a6da98687e4b4ae6718. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:49:56.337520 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] [instance: fab140cf-557a-406a-ba10-106ab36f3b38] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:49:56.337520 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:49:56.342770 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:49:56.422468 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] [instance: fab140cf-557a-406a-ba10-106ab36f3b38] block_device_mapping [BlockDeviceMapping(attachment_id=0418bd6b-2ebd-4166-9869-fd3f406760f2,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcf71dc6-a3e4-47dd-b21f-e1147dffa92e',volume_size=1,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:49:56.423732 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:49:56.424140 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:49:56.674374 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:49:56.675051 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6c0008eb-2a10-4337-8095-fe702ba1a77d tempest-TestVolumeBackupRestore-1118737836 tempest-TestVolumeBackupRestore-1118737836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:50:12.378694 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:50:13.408859 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 39662. Jul 08 08:50:31.507723 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:50:31.516055 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:50:32.543563 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 40062. Jul 08 08:50:34.043088 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:50:42.674490 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-fd49bb8b-6617-4234-bade-26870f7c7a4d tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:50:42.676128 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd49bb8b-6617-4234-bade-26870f7c7a4d tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:50:42.676459 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fd49bb8b-6617-4234-bade-26870f7c7a4d tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:50:43.460225 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-fd49bb8b-6617-4234-bade-26870f7c7a4d tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] [instance: 11109832-4cd3-4451-88c9-152fe8e01e58] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 08:50:44.330436 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-fd49bb8b-6617-4234-bade-26870f7c7a4d tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Created allocations for migration d4073ba2-bec0-442a-be84-fc196697193f on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:50:44.835086 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-fd49bb8b-6617-4234-bade-26870f7c7a4d tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] [instance: 11109832-4cd3-4451-88c9-152fe8e01e58] Calling prep_resize with selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 08:52:15.057016 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:52:15.975811 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:52:16.977001 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:52:17.019311 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 41904. Jul 08 08:52:35.894683 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:52:38.715831 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:52:38.788826 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:52:38.789224 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:52:39.016694 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:52:39.017548 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:52:39.019246 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:52:39.024894 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:52:39.074850 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Getting quotas for project 989ced0b00514c5d9a9fa8c170380175. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:52:39.097295 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Getting quotas for user 3ccfc8942869438c98c0854629827531 and project 989ced0b00514c5d9a9fa8c170380175. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:52:39.122499 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] [instance: 759fcf84-e2b9-442e-b523-90ce295064c4] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:52:39.129747 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:52:39.132738 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:52:39.212148 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] [instance: 759fcf84-e2b9-442e-b523-90ce295064c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:52:39.213938 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:52:39.214904 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:52:39.561230 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:52:39.561812 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-15910f65-aab8-43fb-af32-99b154504e89 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:52:41.489460 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:52:42.541750 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 42748. Jul 08 08:52:43.648175 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:52:44.713481 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 42790. Jul 08 08:52:57.572384 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:53:13.399422 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:53:14.424840 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 43388. Jul 08 08:53:32.543712 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:53:33.563648 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 43908. Jul 08 08:53:51.534721 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:53:54.083349 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:53:55.574474 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:53:55.596970 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:53:55.597939 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:53:55.773955 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:53:55.774354 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:53:55.775067 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:53:55.775449 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:53:55.790080 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Getting quotas for project 75d5607c3dfe40bdbb5a4a29eeb2ed05. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:53:55.794442 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Getting quotas for user f02bce8a615041ed89cba63e6796ec8a and project 75d5607c3dfe40bdbb5a4a29eeb2ed05. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:53:55.804598 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] [instance: 2f4b7d0c-72fd-4d9d-9daf-8c8482149339] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:53:55.805477 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:53:55.805870 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:53:56.026168 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] [instance: 2f4b7d0c-72fd-4d9d-9daf-8c8482149339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:53:56.027540 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:53:56.030613 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:53:56.312397 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:53:56.312676 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-01e7cb6d-44dc-4da0-be6a-0f95c1de0222 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:54:23.154969 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-48d395f6-6f0b-471a-9051-8adca904c1a0 tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:54:23.158146 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-48d395f6-6f0b-471a-9051-8adca904c1a0 tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:54:23.158806 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-48d395f6-6f0b-471a-9051-8adca904c1a0 tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:54:23.566500 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-48d395f6-6f0b-471a-9051-8adca904c1a0 tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] [instance: 759fcf84-e2b9-442e-b523-90ce295064c4] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 08:54:24.733731 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-48d395f6-6f0b-471a-9051-8adca904c1a0 tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Created allocations for migration 4ee9d764-018c-40ba-af5f-59aaf5829a58 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:54:25.418772 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-48d395f6-6f0b-471a-9051-8adca904c1a0 tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] [instance: 759fcf84-e2b9-442e-b523-90ce295064c4] Calling prep_resize with selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 08:55:37.323637 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Took 1.09 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:55:37.350659 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:37.351064 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:37.526425 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:37.526826 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:37.527589 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:37.528239 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:37.552811 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Getting quotas for project 75d5607c3dfe40bdbb5a4a29eeb2ed05. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:55:37.558186 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Getting quotas for user f02bce8a615041ed89cba63e6796ec8a and project 75d5607c3dfe40bdbb5a4a29eeb2ed05. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:55:37.572481 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] [instance: 67bba0da-d15e-4ca8-8ed9-3285f6f9063a] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:55:37.573601 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:37.574294 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:37.637758 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] [instance: 67bba0da-d15e-4ca8-8ed9-3285f6f9063a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:55:37.639899 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:37.641022 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:37.914062 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:37.914959 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-68fe1c4c-96c5-45ec-b5e2-5b2cb54829d6 tempest-VolumesSnapshotTestJSON-246780480 tempest-VolumesSnapshotTestJSON-246780480-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:42.539067 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:55:43.303378 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:55:43.359874 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:43.361130 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:43.584746 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 46640. Jul 08 08:55:43.631047 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:43.631749 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:43.633908 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:43.634826 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:43.672027 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Getting quotas for project ef616960ea704e4ba86b7285822ffbfb. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:55:43.677967 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Getting quotas for user 771d792a51dd451c9c259d0f09fc4844 and project ef616960ea704e4ba86b7285822ffbfb. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:55:43.691517 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] [instance: 65d8090a-e0b0-4511-9075-681725a4b4f6] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:55:43.692714 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:43.693122 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:43.755611 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] [instance: 65d8090a-e0b0-4511-9075-681725a4b4f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:55:43.756913 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:43.757604 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:44.081691 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:55:44.082188 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42b8db3e-3006-4147-9b86-7ebe2d904d62 tempest-VolumesBackupsTest-427150120 tempest-VolumesBackupsTest-427150120-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:55:55.925136 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:56:17.621206 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:56:33.566801 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:56:34.597957 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 47302. Jul 08 08:56:43.512974 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:56:43.562454 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:56:43.563250 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:56:43.715538 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:56:43.716013 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:56:43.716769 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:56:43.717154 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:56:43.762792 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Getting quotas for project 989ced0b00514c5d9a9fa8c170380175. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:56:43.814147 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Getting quotas for user 3ccfc8942869438c98c0854629827531 and project 989ced0b00514c5d9a9fa8c170380175. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:56:43.834868 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] [instance: b804243b-b586-4f92-af50-9e767d01c56d] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:56:43.836404 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:56:43.852245 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:56:43.951141 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] [instance: b804243b-b586-4f92-af50-9e767d01c56d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:56:43.960118 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:56:43.966905 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:56:44.229516 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:56:44.231206 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-c11c199f-59d5-43dc-a6f6-a00f92c9c3f3 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:57:44.699781 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:57:45.730916 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 48860. Jul 08 08:58:13.279413 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-94f5b84d-036d-4009-bed6-98171a3446ca tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 08:58:13.280039 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-94f5b84d-036d-4009-bed6-98171a3446ca tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:58:13.280172 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-94f5b84d-036d-4009-bed6-98171a3446ca tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:58:14.095169 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-94f5b84d-036d-4009-bed6-98171a3446ca tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Created allocations for migration 19cdd872-ae58-4153-b019-0c7902a5307b on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82011) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 08:58:14.379712 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.live_migrate [None req-94f5b84d-036d-4009-bed6-98171a3446ca tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] [instance: b804243b-b586-4f92-af50-9e767d01c56d] Requesting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while live migrating {{(pid=82011) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:495}} Jul 08 08:58:14.423615 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 08:58:15.443782 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49210. Jul 08 08:58:16.988825 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-94f5b84d-036d-4009-bed6-98171a3446ca tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Lazy-loading 'resources' on Instance uuid b804243b-b586-4f92-af50-9e767d01c56d {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:58:16.994336 chdv-799894-1 nova-conductor[82011]: DEBUG nova.objects.instance [None req-94f5b84d-036d-4009-bed6-98171a3446ca tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] Lazy-loading 'pci_requests' on Instance uuid b804243b-b586-4f92-af50-9e767d01c56d {{(pid=82011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jul 08 08:58:17.924132 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.live_migrate [None req-94f5b84d-036d-4009-bed6-98171a3446ca tempest-TestNetworkAdvancedServerOps-1507416147 tempest-TestNetworkAdvancedServerOps-1507416147-project-admin] [instance: b804243b-b586-4f92-af50-9e767d01c56d] Start binding ports on destination host: chh2-799894-1 {{(pid=82011) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Jul 08 08:58:26.790229 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] [6eaafeb1-b779-41e9-8851-0c876b168a94] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 08 08:58:27.834794 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] [6eaafeb1-b779-41e9-8851-0c876b168a94] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49326. Jul 08 08:58:28.542285 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Took 1.76 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:58:28.583083 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:58:28.583489 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:58:28.797707 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:58:28.798530 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:58:28.799552 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:58:28.800163 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:58:28.852078 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Getting quotas for project 4c57e9f1b6774f2fbda0b1341b19c258. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:58:28.853297 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Getting quotas for user 3b1a57a2f14a4748a908711aa64133aa and project 4c57e9f1b6774f2fbda0b1341b19c258. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:58:28.864516 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] [instance: c9532bf2-2ed5-4709-8415-24ccd385e3e8] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:58:28.866261 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:58:28.866656 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:58:28.931782 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] [instance: c9532bf2-2ed5-4709-8415-24ccd385e3e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:58:28.934401 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:58:28.935063 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:58:29.282201 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:58:29.283996 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:58:29.300414 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] [61a201aa-ac95-48ae-a8e7-7238d958c1ac] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 08 08:58:30.329945 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3232a6c-a749-4771-b0ee-128f16f8b558 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] [61a201aa-ac95-48ae-a8e7-7238d958c1ac] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49362. Jul 08 08:58:43.585020 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 08:58:44.605348 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49536. Jul 08 08:59:15.462539 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 08:59:15.505447 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:59:15.506011 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:59:15.811242 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:59:15.812549 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:59:15.815327 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:59:15.815327 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:59:15.836634 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Getting quotas for project 989ced0b00514c5d9a9fa8c170380175. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 08:59:15.841806 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Getting quotas for user 3ccfc8942869438c98c0854629827531 and project 989ced0b00514c5d9a9fa8c170380175. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 08:59:15.853992 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] [instance: de75a8ca-9c68-41ff-830e-9bfc2ec52d59] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 08:59:15.855181 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:59:15.855749 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:59:15.946968 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 08:59:15.970593 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] [instance: de75a8ca-9c68-41ff-830e-9bfc2ec52d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 08:59:15.977392 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:59:15.977392 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:59:16.272830 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 08:59:16.272830 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a4f48bdf-5ce6-4501-bea5-692c43020e78 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 08:59:37.658419 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:00:12.616258 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:00:12.648610 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:00:12.648610 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:00:12.869473 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:00:12.869473 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:00:12.869473 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:00:12.869473 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:00:12.892287 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Getting quotas for project 4c57e9f1b6774f2fbda0b1341b19c258. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:00:12.899647 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Getting quotas for user 3b1a57a2f14a4748a908711aa64133aa and project 4c57e9f1b6774f2fbda0b1341b19c258. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:00:12.916058 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] [instance: 0da690a9-a262-4710-8069-323fff10dd64] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:00:12.917293 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:00:12.917785 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:00:13.003069 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] [instance: 0da690a9-a262-4710-8069-323fff10dd64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:00:13.003943 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:00:13.004607 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:00:13.215001 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:00:13.215001 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-42ab3d35-5090-41a4-ab3a-8e25b08c5748 tempest-TestSecurityGroupsBasicOps-282832737 tempest-TestSecurityGroupsBasicOps-282832737-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:00:34.600518 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:00:35.625114 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 51628. Jul 08 09:00:39.670570 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5b6401a8-e119-46af-974e-f68d34666b56 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method rebuild_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 09:00:39.672543 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5b6401a8-e119-46af-974e-f68d34666b56 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:00:39.673269 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5b6401a8-e119-46af-974e-f68d34666b56 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:00:39.790736 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5b6401a8-e119-46af-974e-f68d34666b56 tempest-TestNetworkAdvancedServerOps-204385520 tempest-TestNetworkAdvancedServerOps-204385520-project] [instance: de75a8ca-9c68-41ff-830e-9bfc2ec52d59] No migration record for the rebuild/evacuate request. {{(pid=82011) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Jul 08 09:01:08.035679 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Took 1.04 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:01:08.069175 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:01:08.069664 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:01:08.320937 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:01:08.321338 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:01:08.322060 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:01:08.322449 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:01:08.338698 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Getting quotas for project 0017835a0dea42799f02fc4866abf22c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:01:08.343667 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Getting quotas for user 01cafa9b27c74bbc9955d18181b0e8c2 and project 0017835a0dea42799f02fc4866abf22c. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:01:08.354403 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] [instance: fbdb381a-e3fe-463d-8f51-c3f6b593b974] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:01:08.355386 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:01:08.355795 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:01:08.430817 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] [instance: fbdb381a-e3fe-463d-8f51-c3f6b593b974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:01:08.433241 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:01:08.433241 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:01:08.634009 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:01:08.634405 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-e8d7745f-bf8e-44ac-8a2c-af08ce098a48 tempest-TestServerAdvancedOps-670366925 tempest-TestServerAdvancedOps-670366925-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:01:17.023317 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:01:18.065220 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52808. Jul 08 09:01:44.604650 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:01:45.621984 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53312. Jul 08 09:02:15.095790 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:02:18.448792 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Took 1.39 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:02:18.497584 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:18.498231 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:18.747205 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:18.748120 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:18.750369 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:18.751083 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:18.775506 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Getting quotas for project 898988796f944d0b8eec0fe7f4f231e9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:02:18.782516 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Getting quotas for user c04b905ad3284b7b8d0284b33e9d4ccf and project 898988796f944d0b8eec0fe7f4f231e9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:02:18.799499 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] [instance: 1fe4a4d9-d0bc-490a-845e-f51aca064847] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:02:18.814410 chdv-799894-1 nova-conductor[82011]: DEBUG nova.scheduler.utils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Re-scheduling is disabled due to forcing a host (['chh1-799894-1']) and/or node ([]) {{(pid=82011) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Jul 08 09:02:18.815479 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:18.816080 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:18.882189 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] [instance: 1fe4a4d9-d0bc-490a-845e-f51aca064847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:02:18.883776 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:18.884347 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:19.148071 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:19.148494 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-f3df5fad-e28d-4a1e-9098-e02829dbcde2 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.040831 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:02:41.064232 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:41.064872 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.247605 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:41.248660 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.249623 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:41.250044 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.266142 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Getting quotas for project ca84410c74c54a26a4093edc8eb657a8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:02:41.270779 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Getting quotas for user 8d2278319d3c4284a4902529d21b748b and project ca84410c74c54a26a4093edc8eb657a8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:02:41.285189 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] [instance: 582aec35-78ea-401d-80c1-a8cfe00d2beb] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:02:41.286198 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:41.286598 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.393479 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] [instance: 582aec35-78ea-401d-80c1-a8cfe00d2beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:02:41.395459 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:41.396113 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.688810 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:41.689336 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-25445f80-e4f2-4477-80e6-1f8e750bd00e tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.785488 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:02:41.811714 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:41.812402 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.965252 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:41.965956 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.967654 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:41.969708 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:41.991593 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Getting quotas for project 898988796f944d0b8eec0fe7f4f231e9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:02:41.999806 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Getting quotas for user c04b905ad3284b7b8d0284b33e9d4ccf and project 898988796f944d0b8eec0fe7f4f231e9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:02:42.014282 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] [instance: 53327596-f24c-4572-a122-ad9bc99c12cc] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:02:42.015947 chdv-799894-1 nova-conductor[82011]: DEBUG nova.scheduler.utils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Re-scheduling is disabled due to forcing a host (['chh2-799894-1']) and/or node ([]) {{(pid=82011) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Jul 08 09:02:42.015947 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:42.016310 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:42.121767 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] [instance: 53327596-f24c-4572-a122-ad9bc99c12cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:02:42.125053 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:42.125298 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:42.420789 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:02:42.420789 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-21bd2b86-54a0-4ad6-821d-a0ba04c17124 tempest-TestServerMultinode-614842987 tempest-TestServerMultinode-614842987-project-admin] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:02:57.687799 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:03:35.625051 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:03:36.640899 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 55508. Jul 08 09:03:39.850437 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:03:39.873160 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:03:39.873531 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:03:39.992667 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:03:39.993066 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:03:39.993809 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:03:39.994185 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:03:40.012481 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Getting quotas for project ca84410c74c54a26a4093edc8eb657a8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:03:40.017534 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Getting quotas for user 8d2278319d3c4284a4902529d21b748b and project ca84410c74c54a26a4093edc8eb657a8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:03:40.027954 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] [instance: f1174ec1-390f-4cdf-a7dd-c261d2af2fca] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:03:40.031145 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:03:40.031145 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:03:40.130186 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] [instance: f1174ec1-390f-4cdf-a7dd-c261d2af2fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:03:40.131633 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:03:40.132144 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:03:40.365071 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:03:40.365487 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-3357a00f-dcde-4474-b7ef-3a0f806e5428 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:04:31.708134 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:04:31.738101 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:04:31.738101 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:04:31.915348 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:04:31.916204 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:04:31.917152 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:04:31.917717 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:04:31.936630 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Getting quotas for project f41154fe3a5a40f08a8da0134d5a0ee9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:04:31.942912 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Getting quotas for user 8e8e8063b6bf4329b0a5e62a0d6c39c3 and project f41154fe3a5a40f08a8da0134d5a0ee9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:04:31.953969 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] [instance: 1d24c314-e712-45e8-9d74-47cc9c782c19] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:04:31.954904 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:04:31.955300 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:04:32.025756 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] [instance: 1d24c314-e712-45e8-9d74-47cc9c782c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:04:32.027112 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:04:32.027572 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:04:32.220213 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:04:32.221040 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-43916314-e200-4238-a26d-f63d9842250f tempest-TestServerBasicOps-1065219712 tempest-TestServerBasicOps-1065219712-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:04:45.623780 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:04:46.641177 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 56516. Jul 08 09:05:07.795974 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:05:07.818270 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:05:07.818670 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:05:07.909979 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:05:07.910373 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:05:07.911079 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:05:07.911455 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:05:07.927480 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Getting quotas for project ca84410c74c54a26a4093edc8eb657a8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:05:07.931909 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Getting quotas for user 8d2278319d3c4284a4902529d21b748b and project ca84410c74c54a26a4093edc8eb657a8. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:05:07.942264 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] [instance: 8f34cfc3-ad88-4993-9323-4b4e2f1b7071] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:05:07.943162 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:05:07.943765 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:05:07.995928 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] [instance: 8f34cfc3-ad88-4993-9323-4b4e2f1b7071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:05:07.997092 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:05:07.997601 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:05:08.212867 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:05:08.213262 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-7c167263-26d6-4c1e-882a-52541de21f68 tempest-TestNetworkBasicOps-1845072027 tempest-TestNetworkBasicOps-1845072027-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:05:55.977189 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:06:17.709575 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:06:31.164619 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:06:31.188473 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:06:31.188873 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:06:31.421281 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:06:31.421678 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:06:31.422386 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:06:31.422767 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:06:31.438771 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:06:31.443876 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for user 848a864ed6764c87aa84ddd2baf65a32 and project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:06:31.454156 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: 9fda5cfb-acab-4dfd-ae3e-29474975d5c7] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:06:31.454982 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:06:31.455785 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:06:31.535339 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: 9fda5cfb-acab-4dfd-ae3e-29474975d5c7] block_device_mapping [BlockDeviceMapping(attachment_id=942dc44c-2d03-46c1-b8f7-231754d848d4,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5821bb9-7c0e-430b-8414-e4f2272afc41',volume_size=1,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:06:31.536576 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:06:31.536999 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:06:31.743641 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:06:31.744153 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-8686c27f-0c00-4775-957a-ba0c57a82309 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:06:36.640281 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:06:37.655897 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 56972. Jul 08 09:07:15.449299 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:07:16.465542 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 57118. Jul 08 09:07:24.729392 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:07:24.751642 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:07:24.752041 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:07:24.853726 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:07:24.854120 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:07:24.854830 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:07:24.855209 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:07:24.871504 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:07:24.875932 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for user 848a864ed6764c87aa84ddd2baf65a32 and project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:07:24.886717 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: 55d82b64-5989-4930-9574-af125bea0829] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:07:24.892740 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:07:24.892740 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:07:24.987343 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: 55d82b64-5989-4930-9574-af125bea0829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f45fca87-19f7-4f44-8ca0-8d05f0a87244',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:07:24.988572 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:07:24.988975 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:07:25.167607 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:07:25.168009 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-fc0d226a-793e-4f73-b3bc-19f59be39640 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:07:46.642337 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:07:47.666149 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 57212. Jul 08 09:08:38.786003 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:08:38.808096 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:08:38.808535 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:08:38.887680 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:08:38.888077 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:08:38.888865 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:08:38.889251 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:08:38.903898 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:08:38.908321 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for user 848a864ed6764c87aa84ddd2baf65a32 and project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:08:38.918864 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: 2b2fdb5f-1ce2-46da-a4b4-c94fb96e06af] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:08:38.919741 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:08:38.920139 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:08:38.958253 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: 2b2fdb5f-1ce2-46da-a4b4-c94fb96e06af] block_device_mapping [BlockDeviceMapping(attachment_id=09842465-4a2a-4119-8e51-60614efefbce,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='34922326-ead0-4103-a48d-47223bdd7b2d',volume_size=1,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:08:38.959502 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:08:38.959909 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:08:39.198885 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:08:39.199287 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-433c0471-efe7-426a-9021-323b593fb635 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:09:01.003538 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:09:01.027152 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:09:01.027545 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:09:01.218349 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:09:01.218749 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:09:01.219471 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:09:01.219863 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:09:01.235239 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:09:01.239671 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for user 848a864ed6764c87aa84ddd2baf65a32 and project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:09:01.250894 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: 84384a37-a923-4dc5-ab32-f1ec28ba3449] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:09:01.251722 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:09:01.252122 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:09:01.334840 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: 84384a37-a923-4dc5-ab32-f1ec28ba3449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e37a15ac-dfe8-4fcf-ae04-1d1be9211e5b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:09:01.336062 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:09:01.336487 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:09:01.562882 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:09:01.563199 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdf84c8f-7ff7-408e-b690-8b5d0f7d4339 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:09:15.997058 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:09:37.657030 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:09:37.729188 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:09:38.675043 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 57598. Jul 08 09:10:34.548719 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:10:34.571430 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:10:34.571831 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:10:34.672639 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:10:34.673032 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:10:34.673736 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:10:34.674116 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:10:34.690559 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:10:34.695120 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for user 848a864ed6764c87aa84ddd2baf65a32 and project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:10:34.705452 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: f121ac51-0b37-4b2e-9d7d-5fbe0f66f961] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:10:34.706362 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:10:34.706757 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:10:34.772872 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: f121ac51-0b37-4b2e-9d7d-5fbe0f66f961] block_device_mapping [BlockDeviceMapping(attachment_id=019e4d29-e15e-4af9-a73b-d9ea9e26b8e1,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='370293ce-1d17-413a-8d3b-6e5f34dc4af8',volume_size=1,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:10:34.774694 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:10:34.775113 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:10:34.954968 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:10:34.955276 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-4a38bf9f-2711-4e23-9c15-2d13fc7b9d6d tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:10:47.671256 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:10:48.685546 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 57982. Jul 08 09:11:16.467640 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:11:17.484843 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58016. Jul 08 09:11:45.736871 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:11:46.757090 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58032. Jul 08 09:12:11.605863 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:12:14.146662 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:12:36.015881 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:12:38.675630 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:12:39.692389 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58062. Jul 08 09:12:42.724396 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:12:43.745112 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58066. Jul 08 09:12:57.749819 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:13:18.074518 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:13:19.091463 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58080. Jul 08 09:13:43.918617 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:13:43.946491 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:13:43.946891 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:13:44.078742 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:13:44.079160 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:13:44.079874 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:13:44.080257 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:13:44.098302 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:13:44.102763 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for user 848a864ed6764c87aa84ddd2baf65a32 and project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:13:44.113542 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: f0a36e55-e648-450b-bfae-534a606e3ea6] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:13:44.114433 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:13:44.114825 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:13:44.195002 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: f0a36e55-e648-450b-bfae-534a606e3ea6] block_device_mapping [BlockDeviceMapping(attachment_id=41581790-7fed-4e5a-8dc4-1db882e68a25,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='370293ce-1d17-413a-8d3b-6e5f34dc4af8',volume_size=1,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:13:44.196157 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:13:44.196592 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:13:44.469839 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:13:44.470177 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-6074371e-98db-4138-af1b-4eb7fd373a08 tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:13:48.684066 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:13:49.717218 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58206. Jul 08 09:15:35.131148 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:15:37.052974 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:15:39.693779 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:15:40.710306 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58296. Jul 08 09:15:43.741265 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:15:44.761652 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58298. Jul 08 09:15:46.753294 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:15:47.775051 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58300. Jul 08 09:15:56.034286 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:16:17.486705 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:16:17.770838 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:16:18.507601 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58310. Jul 08 09:16:19.091979 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:16:20.108239 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58316. Jul 08 09:16:49.711816 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:16:50.727129 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58386. Jul 08 09:16:55.703944 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Took 2.59 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:16:55.726200 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:16:55.726599 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:16:55.842356 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:16:55.842738 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:16:55.843523 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:16:55.843905 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:16:55.860796 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:16:55.865315 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Getting quotas for user 848a864ed6764c87aa84ddd2baf65a32 and project fd027b80fbb548eda53f83947dd87c86. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:16:55.876127 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: d3b7c4ad-02c1-4de1-ab00-ddca24735dc4] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:16:55.877060 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:16:55.877450 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:16:55.922373 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] [instance: d3b7c4ad-02c1-4de1-ab00-ddca24735dc4] block_device_mapping [BlockDeviceMapping(attachment_id=931a17a3-69f5-48cc-b159-d3d6db838d2d,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0446b65d-7a1b-4b13-a362-a65ffaf92fe8',volume_size=1,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:16:55.925867 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:16:55.925867 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:16:56.140361 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:16:56.140702 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a98c7f48-99b8-4157-8870-36abd811efba tempest-TestVolumeBootPattern-1032082226 tempest-TestVolumeBootPattern-1032082226-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:18:40.712070 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:18:41.729048 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58528. Jul 08 09:18:47.771858 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:18:48.793341 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58532. Jul 08 09:18:51.635760 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:18:54.171053 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:19:16.055236 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:19:18.507312 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:19:19.524301 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58550. Jul 08 09:19:20.109350 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:19:21.125723 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58552. Jul 08 09:19:37.792958 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:19:44.759855 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:19:45.784297 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58566. Jul 08 09:19:50.735098 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:19:51.751692 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58588. Jul 08 09:20:35.845505 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:20:35.866877 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:20:35.867277 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:20:35.999214 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:20:35.999625 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:20:36.000323 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:20:36.000789 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:20:36.016044 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Getting quotas for project 1ce993d9fdbf46ddbde35e4fc899d81b. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:20:36.020535 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Getting quotas for user 62cb6f3c05524c1ba50223bc17ef4143 and project 1ce993d9fdbf46ddbde35e4fc899d81b. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:20:36.032193 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] [instance: 8f4e999e-3f26-43a3-a0fd-ebe924fb9e28] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:20:36.033178 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:20:36.033568 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:20:36.085733 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] [instance: 8f4e999e-3f26-43a3-a0fd-ebe924fb9e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:20:36.086995 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:20:36.087984 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:20:36.257812 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:20:36.258139 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bacdbb6c-27de-49b1-b7ae-5f707a328143 tempest-ServersAdminNegativeTestJSON-811738794 tempest-ServersAdminNegativeTestJSON-811738794-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:21:03.142677 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:21:03.164917 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:21:03.167676 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:21:03.327002 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:21:03.327395 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:21:03.328108 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:21:03.328545 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:21:03.344247 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Getting quotas for project e6063b0239cd4dd187e81c9eb48379e9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:21:03.348735 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Getting quotas for user ffa463cb7661428791ec3f8f073f1956 and project e6063b0239cd4dd187e81c9eb48379e9. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:21:03.359486 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] [instance: 46412641-6349-42e3-a9ac-043bf75c0781] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:21:03.360396 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:21:03.360796 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:21:03.428386 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] [instance: 46412641-6349-42e3-a9ac-043bf75c0781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:21:03.429545 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:21:03.429945 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:21:03.644311 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:21:03.644735 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a3067ca6-1cd7-4fc9-930a-16530d088ac4 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:21:15.994076 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-cdc0ab18-10fa-40d9-864b-f71b5b58cf85 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 09:21:15.994652 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdc0ab18-10fa-40d9-864b-f71b5b58cf85 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:21:15.995124 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-cdc0ab18-10fa-40d9-864b-f71b5b58cf85 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:21:16.337813 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-cdc0ab18-10fa-40d9-864b-f71b5b58cf85 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] [instance: 46412641-6349-42e3-a9ac-043bf75c0781] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 09:21:16.835743 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-cdc0ab18-10fa-40d9-864b-f71b5b58cf85 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] Created allocations for migration 02500040-9079-4665-83a0-648637c74b24 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 09:21:17.162595 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-cdc0ab18-10fa-40d9-864b-f71b5b58cf85 tempest-DeleteServersTestJSON-1025229836 tempest-DeleteServersTestJSON-1025229836-project] [instance: 46412641-6349-42e3-a9ac-043bf75c0781] Calling prep_resize with selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"97482c17-d206-4c76-b496-62a0dc51a4e3": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["97482c17-d206-4c76-b496-62a0dc51a4e3"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=97482c17-d206-4c76-b496-62a0dc51a4e3,limits=SchedulerLimits,nodename='chh1-799894-1',service_host='chh1-799894-1')] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 09:21:41.730450 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:21:42.751164 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59036. Jul 08 09:22:05.273008 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:22:05.296162 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:05.296580 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:05.483700 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:05.484094 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:05.484839 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:05.485224 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:05.500098 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Getting quotas for project 407d65a5ae6b4ba2bb66653bd0f121f6. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:22:05.504457 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Getting quotas for user 811f12a852064be9a98b7eb28f388e6f and project 407d65a5ae6b4ba2bb66653bd0f121f6. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:22:05.514665 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] [instance: ed9a7596-96af-4cc6-8c54-b81a96228262] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:22:05.515474 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:05.515906 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:05.581191 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] [instance: ed9a7596-96af-4cc6-8c54-b81a96228262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:22:05.582383 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:05.582805 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:05.790949 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:05.791319 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-49889a0b-658d-4b96-a675-da54ac333ae9 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:17.651043 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-57ec7151-d0f9-44da-8f53-868c0af162b7 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 09:22:17.651594 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57ec7151-d0f9-44da-8f53-868c0af162b7 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:17.651981 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-57ec7151-d0f9-44da-8f53-868c0af162b7 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:17.936819 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-57ec7151-d0f9-44da-8f53-868c0af162b7 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] [instance: ed9a7596-96af-4cc6-8c54-b81a96228262] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 09:22:18.492062 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-57ec7151-d0f9-44da-8f53-868c0af162b7 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Created allocations for migration 6828dd04-860f-43cd-8482-557a81441361 on 16a62ade-abe7-4fff-b6af-b1d7b02e694d {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 09:22:18.967034 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-57ec7151-d0f9-44da-8f53-868c0af162b7 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] [instance: ed9a7596-96af-4cc6-8c54-b81a96228262] Calling prep_resize with selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"16a62ade-abe7-4fff-b6af-b1d7b02e694d": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["16a62ade-abe7-4fff-b6af-b1d7b02e694d"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=16a62ade-abe7-4fff-b6af-b1d7b02e694d,limits=SchedulerLimits,nodename='chh2-799894-1',service_host='chh2-799894-1')] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 09:22:36.074728 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:22:51.754290 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:22:52.770415 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59282. Jul 08 09:22:55.114953 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:22:55.136724 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:55.137073 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:55.249832 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:55.250237 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:55.250972 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:55.251363 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:55.267222 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Getting quotas for project 407d65a5ae6b4ba2bb66653bd0f121f6. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:22:55.271839 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Getting quotas for user 811f12a852064be9a98b7eb28f388e6f and project 407d65a5ae6b4ba2bb66653bd0f121f6. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:22:55.283231 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] [instance: f631d2d1-b75d-488c-b5a4-eddb5a9c7fbf] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:22:55.284164 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:55.284609 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:55.344160 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] [instance: f631d2d1-b75d-488c-b5a4-eddb5a9c7fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:22:55.345428 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:55.345887 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:55.569320 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:22:55.569729 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-06e595ee-b1d1-43f7-abac-a09242b9121e tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:22:57.812716 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:23:09.764504 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-bff902f7-bd7a-416f-baaa-480e12ba62f5 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 09:23:09.765118 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bff902f7-bd7a-416f-baaa-480e12ba62f5 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:23:09.765394 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-bff902f7-bd7a-416f-baaa-480e12ba62f5 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:23:10.014196 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-bff902f7-bd7a-416f-baaa-480e12ba62f5 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] [instance: f631d2d1-b75d-488c-b5a4-eddb5a9c7fbf] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 09:23:10.510456 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-bff902f7-bd7a-416f-baaa-480e12ba62f5 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] Created allocations for migration 40b82e3f-f716-44a5-8ab8-45af18ae8a23 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 09:23:10.851439 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-bff902f7-bd7a-416f-baaa-480e12ba62f5 tempest-ServerDiskConfigTestJSON-198646841 tempest-ServerDiskConfigTestJSON-198646841-project] [instance: f631d2d1-b75d-488c-b5a4-eddb5a9c7fbf] Calling prep_resize with selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"16a62ade-abe7-4fff-b6af-b1d7b02e694d": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["16a62ade-abe7-4fff-b6af-b1d7b02e694d"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=16a62ade-abe7-4fff-b6af-b1d7b02e694d,limits=SchedulerLimits,nodename='chh2-799894-1',service_host='chh2-799894-1')] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 09:24:07.969386 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:24:07.992611 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:24:07.993011 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:24:08.176248 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:24:08.176687 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:24:08.177398 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:24:08.177794 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:24:08.193873 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Getting quotas for project 8dca397855284339b6243013d7202fca. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:24:08.198382 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Getting quotas for user fbfac12987c24a0b8cbbba26274ddcdc and project 8dca397855284339b6243013d7202fca. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:24:08.208850 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 42b767e2-c97d-4585-ad6d-ad8859b9972b] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:24:08.209713 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:24:08.210119 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:24:08.283494 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 42b767e2-c97d-4585-ad6d-ad8859b9972b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:24:08.284817 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:24:08.285222 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:24:08.529833 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:24:08.530240 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a60ef2e1-7312-4fe8-af5e-840b944fb528 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:24:42.752315 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:24:43.771013 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59632. Jul 08 09:25:19.528466 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:25:20.544190 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59700. Jul 08 09:25:48.792320 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:25:49.814374 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59760. Jul 08 09:25:52.771002 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:25:53.787709 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59768. Jul 08 09:25:56.093457 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:26:17.832800 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:26:21.130630 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:26:22.145630 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59832. Jul 08 09:26:45.783188 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:26:46.806686 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59884. Jul 08 09:26:48.431291 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-31990b5e-6411-481a-bc98-1436b76dea7b tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 09:26:48.431877 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-31990b5e-6411-481a-bc98-1436b76dea7b tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:26:48.432202 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-31990b5e-6411-481a-bc98-1436b76dea7b tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:26:48.797626 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-31990b5e-6411-481a-bc98-1436b76dea7b tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 42b767e2-c97d-4585-ad6d-ad8859b9972b] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 09:26:49.447914 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-31990b5e-6411-481a-bc98-1436b76dea7b tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Created allocations for migration 7ad3b5cc-6ba8-4d6f-887e-795f1ff7326d on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 09:26:49.794755 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-31990b5e-6411-481a-bc98-1436b76dea7b tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 42b767e2-c97d-4585-ad6d-ad8859b9972b] Calling prep_resize with selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"16a62ade-abe7-4fff-b6af-b1d7b02e694d": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["16a62ade-abe7-4fff-b6af-b1d7b02e694d"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=16a62ade-abe7-4fff-b6af-b1d7b02e694d,limits=SchedulerLimits,nodename='chh2-799894-1',service_host='chh2-799894-1')] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 09:27:15.156978 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:27:17.089493 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:27:19.985234 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:27:20.007512 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:27:20.007904 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:27:20.119957 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:27:20.120513 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:27:20.121227 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:27:20.121612 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:27:20.139235 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Getting quotas for project 8dca397855284339b6243013d7202fca. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:27:20.143438 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Getting quotas for user fbfac12987c24a0b8cbbba26274ddcdc and project 8dca397855284339b6243013d7202fca. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:27:20.154077 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: c52a8d8d-f620-4191-9fb7-f62c53e12b3e] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:27:20.154980 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:27:20.155378 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:27:20.225683 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: c52a8d8d-f620-4191-9fb7-f62c53e12b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:27:20.227034 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:27:20.227546 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:27:20.448011 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:27:20.448478 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5a69938b-3fdc-457b-8baf-18237aaa9119 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:27:43.772155 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:27:44.787461 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60078. Jul 08 09:28:49.810650 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:28:50.835442 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60202. Jul 08 09:28:51.681139 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:28:53.788107 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:28:54.205049 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:28:54.805060 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60216. Jul 08 09:29:16.112716 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:29:20.546456 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:29:21.566796 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60274. Jul 08 09:29:22.148731 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:29:23.167802 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60278. Jul 08 09:29:37.852366 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:29:46.801429 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:29:47.823965 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60334. Jul 08 09:30:14.665550 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-a97e2a5d-fc53-45fe-9248-d9e1e676375f tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 09:30:14.666529 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a97e2a5d-fc53-45fe-9248-d9e1e676375f tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:30:14.666529 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-a97e2a5d-fc53-45fe-9248-d9e1e676375f tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:30:14.980012 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-a97e2a5d-fc53-45fe-9248-d9e1e676375f tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: c52a8d8d-f620-4191-9fb7-f62c53e12b3e] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 09:30:15.686789 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-a97e2a5d-fc53-45fe-9248-d9e1e676375f tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Created allocations for migration e373ee04-0c1d-4289-a712-e55965cd0c58 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 09:30:16.237987 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-a97e2a5d-fc53-45fe-9248-d9e1e676375f tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: c52a8d8d-f620-4191-9fb7-f62c53e12b3e] Calling prep_resize with selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"16a62ade-abe7-4fff-b6af-b1d7b02e694d": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["16a62ade-abe7-4fff-b6af-b1d7b02e694d"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=16a62ade-abe7-4fff-b6af-b1d7b02e694d,limits=SchedulerLimits,nodename='chh2-799894-1',service_host='chh2-799894-1')] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 09:30:35.175540 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:30:37.114087 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:30:42.203046 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:30:42.230215 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:30:42.231590 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:30:42.431438 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:30:42.431851 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:30:42.432638 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:30:42.433029 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:30:42.455307 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Getting quotas for project 8dca397855284339b6243013d7202fca. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:30:42.463243 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Getting quotas for user fbfac12987c24a0b8cbbba26274ddcdc and project 8dca397855284339b6243013d7202fca. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:30:42.478473 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 3a378015-bc57-49e4-a000-5b76e0411c93] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:30:42.479484 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:30:42.479884 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:30:42.630207 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 3a378015-bc57-49e4-a000-5b76e0411c93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:30:42.631686 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:30:42.632239 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:30:42.985219 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:30:42.985808 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-881785c3-0548-48be-bb01-732f92cc2143 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:30:44.788322 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:30:45.811519 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60510. Jul 08 09:31:54.806221 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:31:55.824886 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60646. Jul 08 09:32:21.567275 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:32:22.583543 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60698. Jul 08 09:32:36.132258 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:32:47.821895 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:32:48.847426 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60754. Jul 08 09:32:50.831165 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:32:51.867237 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60760. Jul 08 09:32:57.871809 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:33:23.170191 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:33:24.188586 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60830. Jul 08 09:33:28.737481 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-75f504c8-0aa7-44e8-82dc-ad0c8967eb80 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 09:33:28.738110 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-75f504c8-0aa7-44e8-82dc-ad0c8967eb80 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:33:28.738373 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-75f504c8-0aa7-44e8-82dc-ad0c8967eb80 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:33:29.159336 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-75f504c8-0aa7-44e8-82dc-ad0c8967eb80 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 3a378015-bc57-49e4-a000-5b76e0411c93] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82011) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 09:33:29.651935 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-75f504c8-0aa7-44e8-82dc-ad0c8967eb80 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Created allocations for migration dc85a286-1ffb-4450-b1bc-67cff4d2b20a on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82011) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 09:33:30.005105 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-75f504c8-0aa7-44e8-82dc-ad0c8967eb80 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 3a378015-bc57-49e4-a000-5b76e0411c93] Calling prep_resize with selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"16a62ade-abe7-4fff-b6af-b1d7b02e694d": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["16a62ade-abe7-4fff-b6af-b1d7b02e694d"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=16a62ade-abe7-4fff-b6af-b1d7b02e694d,limits=SchedulerLimits,nodename='chh2-799894-1',service_host='chh2-799894-1')] {{(pid=82011) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 09:33:45.811200 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:33:46.831539 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60910. Jul 08 09:34:07.245650 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:34:07.269213 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:34:07.269622 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:34:07.387952 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:34:07.388356 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:34:07.389088 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:34:07.389536 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:34:07.407728 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Getting quotas for project 8dca397855284339b6243013d7202fca. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:34:07.415313 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Getting quotas for user fbfac12987c24a0b8cbbba26274ddcdc and project 8dca397855284339b6243013d7202fca. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:34:07.428479 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 14777500-6327-4cae-acbb-f7886acf3511] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:34:07.429411 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:34:07.429808 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:34:07.570250 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 14777500-6327-4cae-acbb-f7886acf3511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:34:07.572057 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:34:07.572501 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:34:07.907665 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:34:07.908151 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-acb7ab1f-274b-4913-bcb6-5a85dc9d0afc tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:34:55.824354 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:34:56.845512 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 32860. Jul 08 09:35:35.203620 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:35:37.144458 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:35:48.842129 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:35:49.865927 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 32966. Jul 08 09:35:56.161112 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:36:17.891663 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:36:22.586946 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:36:23.604553 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33036. Jul 08 09:36:24.189540 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:36:25.209151 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33042. Jul 08 09:36:46.831859 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:36:47.848114 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33094. Jul 08 09:36:51.856575 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:36:52.880406 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33110. Jul 08 09:37:04.974460 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-a8ebd3bf-2748-42d9-9768-74485e47eb17 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 09:37:04.975948 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a8ebd3bf-2748-42d9-9768-74485e47eb17 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:37:04.976635 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-a8ebd3bf-2748-42d9-9768-74485e47eb17 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:37:05.393772 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-a8ebd3bf-2748-42d9-9768-74485e47eb17 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 14777500-6327-4cae-acbb-f7886acf3511] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82011) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 09:37:06.013505 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-a8ebd3bf-2748-42d9-9768-74485e47eb17 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] Created allocations for migration 52a02308-a404-4e72-b05c-cec770e25523 on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82011) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 09:37:06.491183 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.tasks.migrate [None req-a8ebd3bf-2748-42d9-9768-74485e47eb17 tempest-ServerActionsTestJSON-1057623759 tempest-ServerActionsTestJSON-1057623759-project] [instance: 14777500-6327-4cae-acbb-f7886acf3511] Calling prep_resize with selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"16a62ade-abe7-4fff-b6af-b1d7b02e694d": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["16a62ade-abe7-4fff-b6af-b1d7b02e694d"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=16a62ade-abe7-4fff-b6af-b1d7b02e694d,limits=SchedulerLimits,nodename='chh2-799894-1',service_host='chh2-799894-1')] {{(pid=82011) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 09:37:11.721051 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:37:14.237210 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:37:56.845875 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:37:57.863883 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33280. Jul 08 09:38:19.748463 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:38:19.771650 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:19.772049 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:19.952220 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:19.952655 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:19.953381 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:19.953769 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:19.972752 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Getting quotas for project 12e0961afccc4ea1945edbe81d713ef7. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:38:19.978575 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Getting quotas for user 94b77b2abcba4989a4c3c842cbefb120 and project 12e0961afccc4ea1945edbe81d713ef7. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:38:19.989192 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] [instance: f4f8a935-6c44-42d4-95b1-195aa16dd4f5] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:38:19.990123 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:19.991317 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:20.052298 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] [instance: f4f8a935-6c44-42d4-95b1-195aa16dd4f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:38:20.054442 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:20.054854 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:20.337629 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:20.338114 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-560259d6-6bc4-4654-8c1c-cc055fe4c909 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:34.191800 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:38:34.215228 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:34.215623 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:34.341771 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:34.342163 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:34.342876 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:34.343261 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:34.359452 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Getting quotas for project 12e0961afccc4ea1945edbe81d713ef7. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:38:34.365777 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Getting quotas for user 94b77b2abcba4989a4c3c842cbefb120 and project 12e0961afccc4ea1945edbe81d713ef7. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:38:34.380056 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] [instance: 015784f8-fb8e-4e49-8f97-47fb30ddf6d8] Selected host: chh2-799894-1; Selected node: chh2-799894-1; Alternates: [('chh1-799894-1', 'chh1-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:38:34.381683 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:34.382077 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:34.444196 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] [instance: 015784f8-fb8e-4e49-8f97-47fb30ddf6d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:38:34.445512 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:34.446077 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:38:34.720442 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:38:34.721127 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-02a55402-e55a-4fc1-9e56-f4d333dedea6 tempest-ServersNegativeTestJSON-1011353917 tempest-ServersNegativeTestJSON-1011353917-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:39:16.180709 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:39:37.910512 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:39:47.850300 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:39:48.866528 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33842. Jul 08 09:39:58.402920 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:39:58.427008 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:39:58.430097 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:39:58.626458 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:39:58.626856 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:39:58.627573 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:39:58.628030 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:39:58.643290 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Getting quotas for project 1ae19ca1ffd745ea8839bf4b1d446589. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:39:58.647779 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Getting quotas for user c9c603d69f57434bb9044f3fe5e1924e and project 1ae19ca1ffd745ea8839bf4b1d446589. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:39:58.658711 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] [instance: fe4645ce-04d3-42a9-9f80-cb10e7cb8025] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:39:58.661448 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:39:58.661855 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:39:58.723230 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] [instance: fe4645ce-04d3-42a9-9f80-cb10e7cb8025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:39:58.724287 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:39:58.724720 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:39:58.985824 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:39:58.986223 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-c4b64372-e592-48a9-a0d6-70f9933f59d0 tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:40:35.233246 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:40:36.037929 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:40:36.065759 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:40:36.065759 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:40:36.160790 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:40:36.161294 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:40:36.161892 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:40:36.162274 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:40:36.178135 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Getting quotas for project 1ae19ca1ffd745ea8839bf4b1d446589. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:40:36.185862 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Getting quotas for user c9c603d69f57434bb9044f3fe5e1924e and project 1ae19ca1ffd745ea8839bf4b1d446589. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:40:36.192603 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] [instance: dc8face5-193a-4988-92c7-3c602a4f8985] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:40:36.193500 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:40:36.193887 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:40:36.241509 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] [instance: dc8face5-193a-4988-92c7-3c602a4f8985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:40:36.242749 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:40:36.243152 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:40:36.418028 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:40:36.418429 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-1985f330-d94d-4171-9ec4-5b7a219b41ef tempest-TestEncryptedCinderVolumes-1782925591 tempest-TestEncryptedCinderVolumes-1782925591-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:40:57.864646 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:40:58.881180 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34090. Jul 08 09:42:04.094194 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:42:04.117449 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:42:04.117636 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:42:04.506495 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:42:04.506975 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:42:04.507729 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:42:04.508120 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:42:04.525058 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Getting quotas for project 7f703c63c4ad4ff0931d7288b524f7bf. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:42:04.531424 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Getting quotas for user 4914f5f4ffbd4d578ac0b6e892f4252d and project 7f703c63c4ad4ff0931d7288b524f7bf. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:42:04.541144 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] [instance: 6c070abf-9f7b-4460-84d0-07e093111974] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:42:04.542214 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:42:04.542698 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:42:04.649477 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] [instance: 6c070abf-9f7b-4460-84d0-07e093111974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='436ddb02-76c2-4a28-b373-51f39eb2e7e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:42:04.656455 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:42:04.656455 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:42:04.941393 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:42:04.941832 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-5d480cd2-dc96-410c-b707-4161b4d1a967 tempest-TestMinimumBasicScenario-1624311740 tempest-TestMinimumBasicScenario-1624311740-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:42:36.205288 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:42:48.868653 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:42:49.866962 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:42:49.903719 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34498. Jul 08 09:42:50.907139 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34508. Jul 08 09:42:57.930478 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:43:25.210387 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:43:26.228748 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34546. Jul 08 09:43:55.256419 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:43:58.882266 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:43:59.901818 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34594. Jul 08 09:44:23.612405 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:44:24.629995 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34598. Jul 08 09:44:52.881386 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:44:53.902348 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34602. Jul 08 09:45:37.179654 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:45:42.396827 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:45:42.418801 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:45:42.419206 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:45:42.591456 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:45:42.598534 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:45:42.598534 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:45:42.598534 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:45:42.610722 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:45:42.616413 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for user af2f24e1ebde426fbbeeaa459c13b555 and project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:45:42.627579 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: 4957e413-9758-4a8b-924d-71bd083935b9] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:45:42.629207 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:45:42.629701 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:45:42.698430 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: 4957e413-9758-4a8b-924d-71bd083935b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:45:42.699930 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:45:42.700523 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:45:42.955701 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:45:42.956030 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6737c7dc-3b1c-4fe5-af4a-617f4662ac25 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:45:49.900279 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:45:50.916629 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34910. Jul 08 09:45:56.225503 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:46:17.952203 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:46:59.902638 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:47:00.919785 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34976. Jul 08 09:47:11.761652 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:47:14.273050 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:47:24.630429 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:47:25.646517 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35092. Jul 08 09:47:34.715802 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:47:34.741759 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:47:34.742166 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:47:34.883453 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:47:34.883847 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:47:34.884610 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:47:34.885005 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:47:34.902775 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:47:34.907477 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for user af2f24e1ebde426fbbeeaa459c13b555 and project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:47:34.918969 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: 74931683-e8f9-469b-824e-09ba8529c1b0] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:47:34.920197 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:47:34.920670 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:47:34.988781 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: 74931683-e8f9-469b-824e-09ba8529c1b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:47:34.996517 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:47:34.996517 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:47:35.243453 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:47:35.244026 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-62d4e7f5-b9e1-4184-bc61-582c40c0e4c3 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:47:50.903581 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:47:51.929221 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35174. Jul 08 09:48:26.231549 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:48:27.248292 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35200. Jul 08 09:48:50.917376 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:48:51.934052 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35210. Jul 08 09:48:55.284107 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:48:57.201727 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:49:16.244222 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:49:37.973363 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:49:53.900422 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:49:54.922474 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35282. Jul 08 09:50:00.921905 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:50:01.938223 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35302. Jul 08 09:50:22.209487 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:50:22.236103 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:50:22.236553 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:50:22.344758 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:50:22.345165 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:50:22.345889 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:50:22.346276 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:50:22.363072 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:50:22.368596 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for user af2f24e1ebde426fbbeeaa459c13b555 and project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:50:22.378980 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: de53b52c-0d74-4a1e-a1da-c49a5bd36b1b] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:50:22.379992 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:50:22.380410 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:50:22.438268 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: de53b52c-0d74-4a1e-a1da-c49a5bd36b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:50:22.439485 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:50:22.439832 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:50:22.689941 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:50:22.690404 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7ffd6e3d-9799-42af-8c29-a128ea8df207 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:50:25.649549 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:50:26.667629 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35418. Jul 08 09:50:31.785221 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:50:34.293362 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:51:50.886143 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-1f073f6c-7bb2-452c-862b-bb891fa77c4b tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method migrate_server {{(pid=82010) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 09:51:50.886870 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-1f073f6c-7bb2-452c-862b-bb891fa77c4b tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:51:50.887023 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-1f073f6c-7bb2-452c-862b-bb891fa77c4b tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:51:51.218570 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-1f073f6c-7bb2-452c-862b-bb891fa77c4b tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: de53b52c-0d74-4a1e-a1da-c49a5bd36b1b] Restricting to cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) while migrating {{(pid=82010) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jul 08 09:51:51.785676 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-1f073f6c-7bb2-452c-862b-bb891fa77c4b tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Created allocations for migration 014ee6bc-17dc-49c5-86bf-43235d7620ad on 97482c17-d206-4c76-b496-62a0dc51a4e3 {{(pid=82010) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 08 09:51:51.935433 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:51:52.162271 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.tasks.migrate [None req-1f073f6c-7bb2-452c-862b-bb891fa77c4b tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: de53b52c-0d74-4a1e-a1da-c49a5bd36b1b] Calling prep_resize with selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [Selection(allocation_request='{"allocations": {"16a62ade-abe7-4fff-b6af-b1d7b02e694d": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["16a62ade-abe7-4fff-b6af-b1d7b02e694d"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1fa8d44-2a0d-430d-82d8-b8820088c7cc,compute_node_uuid=16a62ade-abe7-4fff-b6af-b1d7b02e694d,limits=SchedulerLimits,nodename='chh2-799894-1',service_host='chh2-799894-1')] {{(pid=82010) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Jul 08 09:51:52.952088 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35534. Jul 08 09:52:27.250909 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:52:28.267346 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35592. Jul 08 09:52:36.271487 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:52:51.924754 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:52:52.946201 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35606. Jul 08 09:52:57.992484 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:53:01.939129 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:53:02.956696 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35618. Jul 08 09:53:28.323861 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:53:28.347028 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:53:28.347434 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:53:28.453586 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:53:28.453586 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:53:28.454383 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:53:28.454383 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:53:28.471837 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:53:28.479373 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for user af2f24e1ebde426fbbeeaa459c13b555 and project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:53:28.495324 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: 183df2e3-9e7d-49b4-86a7-ee8e5e39b6ea] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:53:28.499601 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:53:28.499601 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:53:28.572188 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: 183df2e3-9e7d-49b4-86a7-ee8e5e39b6ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:53:28.573583 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:53:28.574080 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:53:28.826449 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:53:28.827463 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-87c851a1-73ea-4004-a3d5-9eca819b07f5 tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:54:52.953269 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:54:53.969022 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35824. Jul 08 09:55:28.268784 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:55:29.285457 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35858. Jul 08 09:55:31.813165 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:55:34.319316 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:55:35.316534 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:55:37.226888 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:55:52.941438 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:55:53.962948 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35900. Jul 08 09:55:54.921569 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:55:55.950249 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35910. Jul 08 09:55:56.292426 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:56:02.958195 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:56:03.979238 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35936. Jul 08 09:56:18.013893 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:56:20.578295 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:56:20.605357 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:56:20.610527 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:56:20.743766 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:56:20.744486 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:56:20.745021 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:56:20.745666 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:56:20.768846 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:56:20.775364 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Getting quotas for user af2f24e1ebde426fbbeeaa459c13b555 and project 9990fbcf8914436083a8d9f7975cd04e. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:56:20.789810 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: 6ea69b01-89ed-4b87-98dd-87425ed706da] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:56:20.791035 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:56:20.791626 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:56:20.860655 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] [instance: 6ea69b01-89ed-4b87-98dd-87425ed706da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:56:20.861857 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:56:20.862259 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:56:21.129580 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:56:21.130156 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-7082cbc0-97c4-4465-ba29-204690cdf2ce tempest-TestNetworkAdvancedServerOps-1326599503 tempest-TestNetworkAdvancedServerOps-1326599503-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:56:26.670769 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:56:27.696110 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36048. Jul 08 09:57:53.970253 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:57:54.987999 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36158. Jul 08 09:58:24.640412 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=82010) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 09:58:24.666738 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:58:24.668512 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:58:24.898532 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:58:24.898828 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:58:24.899550 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:58:24.899942 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:58:24.916875 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Getting quotas for project f44132ce2fb1491cacab85a391c4b0a6. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 09:58:24.922031 chdv-799894-1 nova-conductor[82010]: DEBUG nova.quota [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Getting quotas for user 2eeb7d86d5924d0192e71c97236f1a0e and project f44132ce2fb1491cacab85a391c4b0a6. Resources: {'instances', 'cores', 'ram'} {{(pid=82010) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 09:58:24.936571 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] [instance: d27f3c80-320d-4159-aeb7-bd2bb9c33723] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82010) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 09:58:24.937517 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:58:24.938120 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:58:25.048030 chdv-799894-1 nova-conductor[82010]: DEBUG nova.conductor.manager [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] [instance: d27f3c80-320d-4159-aeb7-bd2bb9c33723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82010) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 09:58:25.049437 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:58:25.050058 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:58:25.305079 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 09:58:25.305495 chdv-799894-1 nova-conductor[82010]: DEBUG oslo_concurrency.lockutils [None req-b2cc96b2-3b6e-43ff-8820-ae8dc169432d tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 09:58:29.288547 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:58:30.313869 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36348. Jul 08 09:58:53.960081 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 09:58:54.980847 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36396. Jul 08 09:58:55.335250 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:58:57.247243 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:59:03.978392 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 09:59:04.995283 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36404. Jul 08 09:59:16.320294 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 09:59:38.034600 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:00:27.698080 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:00:28.715644 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36428. Jul 08 10:00:31.845590 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:00:34.342937 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:00:54.988387 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:00:55.945702 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:00:56.004310 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36440. Jul 08 10:00:56.967072 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36442. Jul 08 10:01:30.314217 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:01:31.335618 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36540. Jul 08 10:01:41.076384 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6632ce29-898f-45ec-a61b-276a001e7853 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method unshelve_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 10:01:41.077633 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6632ce29-898f-45ec-a61b-276a001e7853 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:01:41.078100 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-6632ce29-898f-45ec-a61b-276a001e7853 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:01:41.505265 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6632ce29-898f-45ec-a61b-276a001e7853 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] [instance: d27f3c80-320d-4159-aeb7-bd2bb9c33723] Requesting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) during scheduling {{(pid=82011) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Jul 08 10:01:42.093843 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-6632ce29-898f-45ec-a61b-276a001e7853 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 10:02:04.996390 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:02:06.012738 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36674. Jul 08 10:02:36.338550 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:02:58.054986 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:03:28.717123 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:03:29.737609 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36742. Jul 08 10:03:51.867693 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:03:54.365840 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:03:54.978288 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:03:55.358008 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:03:56.005138 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:03:56.007734 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36856. Jul 08 10:03:56.962912 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:03:57.022650 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36874. Jul 08 10:03:57.267542 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:03:57.988662 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36880. Jul 08 10:04:18.350882 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 10:04:18.374704 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:04:18.375093 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:04:18.538447 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:04:18.538887 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:04:18.539609 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:04:18.539994 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:04:18.556120 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Getting quotas for project f44132ce2fb1491cacab85a391c4b0a6. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 10:04:18.561268 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Getting quotas for user 2eeb7d86d5924d0192e71c97236f1a0e and project f44132ce2fb1491cacab85a391c4b0a6. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 10:04:18.571355 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] [instance: 85fd2a29-f138-4870-b4a3-d8c9631e004b] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 10:04:18.572244 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:04:18.572672 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:04:18.631083 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] [instance: 85fd2a29-f138-4870-b4a3-d8c9631e004b] block_device_mapping [BlockDeviceMapping(attachment_id=f0492ce0-72cd-4533-a2b3-05f286d37deb,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44af7f5b-bee3-450f-a4fc-9364140f79ee',volume_size=1,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 10:04:18.632282 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:04:18.632686 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:04:18.881628 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:04:18.881965 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-fee167bb-c7b3-468e-b9fa-502426d4380f tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:05:06.014245 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:05:07.031253 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37024. Jul 08 10:05:56.358372 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:06:18.075326 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:06:29.737438 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:06:30.752905 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37046. Jul 08 10:06:31.338703 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:06:32.355152 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37050. Jul 08 10:06:56.000459 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:06:57.021846 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:06:57.022561 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37060. Jul 08 10:06:57.981653 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:06:58.037182 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37062. Jul 08 10:06:59.004834 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37064. Jul 08 10:07:11.888038 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:07:14.385913 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:07:15.381191 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:07:17.288566 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:07:40.315406 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5844f587-1aa7-4f60-9d02-1f98b37bc331 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Targeting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) for conductor method unshelve_instance {{(pid=82011) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Jul 08 10:07:40.316059 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5844f587-1aa7-4f60-9d02-1f98b37bc331 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:07:40.316255 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-5844f587-1aa7-4f60-9d02-1f98b37bc331 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:07:40.731262 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5844f587-1aa7-4f60-9d02-1f98b37bc331 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] [instance: 85fd2a29-f138-4870-b4a3-d8c9631e004b] Requesting cell f1fa8d44-2a0d-430d-82d8-b8820088c7cc(cell1) during scheduling {{(pid=82011) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Jul 08 10:07:41.219164 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-5844f587-1aa7-4f60-9d02-1f98b37bc331 tempest-TestShelveInstance-604868045 tempest-TestShelveInstance-604868045-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 10:08:07.032968 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:08:08.048648 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37198. Jul 08 10:09:16.377132 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:09:30.755114 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:09:31.771616 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37222. Jul 08 10:09:38.094948 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:09:57.018661 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:09:58.040325 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:09:58.046346 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37240. Jul 08 10:09:59.001551 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:09:59.063119 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37252. Jul 08 10:10:00.023869 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37260. Jul 08 10:10:31.907310 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:10:32.358269 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:10:33.376451 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37410. Jul 08 10:10:34.406597 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:10:35.402311 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:10:37.308872 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:10:42.264818 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 10:10:42.287237 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:10:42.287648 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:10:42.453744 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:10:42.454089 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:10:42.454799 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:10:42.455180 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:10:42.472971 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Getting quotas for project 7427ee6053144ac09e21debf1989afcf. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 10:10:42.478680 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Getting quotas for user 490b781b8b7d4cc4aaff11a09cde73f5 and project 7427ee6053144ac09e21debf1989afcf. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 10:10:42.489876 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] [instance: dd3b4e52-9792-40bd-8b94-ed946055781d] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 10:10:42.491419 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:10:42.491818 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:10:42.554919 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] [instance: dd3b4e52-9792-40bd-8b94-ed946055781d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef0b1ddd-8519-429e-b3e1-e5cf73602433',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 10:10:42.556162 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:10:42.556611 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:10:42.832868 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:10:42.832868 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-2294db16-1e8e-4e71-ab22-1b04100bfd5a tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:11:08.049192 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:11:09.065717 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37536. Jul 08 10:12:31.772347 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:12:32.791292 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37564. Jul 08 10:12:36.396590 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:12:58.037678 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:12:58.114894 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:12:59.060819 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37586. Jul 08 10:12:59.063126 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:13:00.021067 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:13:00.079649 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37588. Jul 08 10:13:01.042227 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37590. Jul 08 10:13:33.381031 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:13:34.394178 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37596. Jul 08 10:13:51.940398 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:13:54.430362 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:13:55.429666 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:13:57.329113 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:13:59.136460 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=82011) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Jul 08 10:13:59.160521 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:13:59.160927 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:13:59.432365 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:13:59.432699 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:13:59.433480 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:13:59.433873 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:13:59.449535 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Getting quotas for project 7427ee6053144ac09e21debf1989afcf. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 08 10:13:59.454119 chdv-799894-1 nova-conductor[82011]: DEBUG nova.quota [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Getting quotas for user 490b781b8b7d4cc4aaff11a09cde73f5 and project 7427ee6053144ac09e21debf1989afcf. Resources: {'instances', 'cores', 'ram'} {{(pid=82011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 08 10:13:59.465987 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] [instance: ee3dd9c6-0c88-4c21-abac-afb8c472bf29] Selected host: chh1-799894-1; Selected node: chh1-799894-1; Alternates: [('chh2-799894-1', 'chh2-799894-1')] {{(pid=82011) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Jul 08 10:13:59.466929 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:13:59.467326 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:13:59.555620 chdv-799894-1 nova-conductor[82011]: DEBUG nova.conductor.manager [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] [instance: ee3dd9c6-0c88-4c21-abac-afb8c472bf29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ce8755f-6abd-4b66-9e63-71073690f734',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=82011) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Jul 08 10:13:59.556921 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:13:59.557316 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:13:59.821282 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 08 10:13:59.821683 chdv-799894-1 nova-conductor[82011]: DEBUG oslo_concurrency.lockutils [None req-dba6c9af-8b91-41d8-91ba-cc46bfd50e03 tempest-TestSnapshotPattern-1034537922 tempest-TestSnapshotPattern-1034537922-project] Lock "f1fa8d44-2a0d-430d-82d8-b8820088c7cc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 08 10:14:09.068904 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:14:10.087467 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37820. Jul 08 10:15:32.791062 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:15:33.807974 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37894. Jul 08 10:15:56.416657 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:15:59.056266 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:16:00.076923 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37912. Jul 08 10:16:00.079863 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:16:01.038880 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:16:01.096327 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37914. Jul 08 10:16:02.063099 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37916. Jul 08 10:16:18.135580 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:16:34.394251 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:16:35.411862 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 37938. Jul 08 10:17:10.088212 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:17:11.114902 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38158. Jul 08 10:17:11.959751 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:17:14.449728 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:17:15.452697 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:17:17.350415 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:18:33.809043 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:18:34.825751 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38228. Jul 08 10:19:00.073637 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:19:01.094944 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38234. Jul 08 10:19:01.096607 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:19:02.055481 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:19:02.113166 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38236. Jul 08 10:19:03.078137 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38238. Jul 08 10:19:16.435041 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:19:35.412433 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:19:36.429910 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38242. Jul 08 10:19:38.156551 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:20:11.104076 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:20:12.119023 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38248. Jul 08 10:20:31.993508 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:20:34.473012 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:20:35.480428 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:20:37.371233 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:21:34.827342 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:21:35.843308 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38266. Jul 08 10:22:01.092120 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:22:02.113931 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:22:02.114987 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38272. Jul 08 10:22:03.073370 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:22:03.130961 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38274. Jul 08 10:22:04.095424 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38276. Jul 08 10:22:36.430257 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 08 10:22:36.453109 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:22:37.446845 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38282. Jul 08 10:22:58.176939 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:23:12.119981 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:23:13.135764 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38288. Jul 08 10:23:52.017997 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:23:54.493033 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:23:55.510637 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:23:57.389204 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:24:35.844249 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:24:36.861007 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38310. Jul 08 10:25:02.109068 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:25:03.130333 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e8fa85c-05e0-4fa1-9cf4-a135f824caf4] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38314. Jul 08 10:25:03.131853 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:25:04.091526 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:25:04.147482 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f4a3ec8-867a-4213-aa38-2b161afbf523] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38316. Jul 08 10:25:05.113238 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [30290134-5bab-43da-be36-c2354f6fe449] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38318. Jul 08 10:25:37.448229 chdv-799894-1 nova-conductor[82011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:25:38.463761 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] [588070b0-c2ee-4e1a-b994-de3ef6367a18] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38320. Jul 08 10:25:56.471477 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:26:13.137075 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:26:14.153695 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa64555-5c4e-4c09-b129-401e46d7e561] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38326. Jul 08 10:26:18.196478 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:27:12.040426 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:27:14.511255 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:27:15.534011 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:27:17.408748 chdv-799894-1 nova-conductor[82011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 08 10:27:36.862973 chdv-799894-1 nova-conductor[82010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] AMQP server on 10.222.0.50:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 08 10:27:37.879832 chdv-799894-1 nova-conductor[82010]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d0f2a1-9d38-4d8e-96c7-b17a4ef2c8cd] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 38348.