-- Logs begin at Wed 2021-09-15 02:12:01 UTC, end at Wed 2021-09-15 05:00:03 UTC. -- Sep 15 02:54:01.522501 chdv-809057-1 systemd[1]: Started Devstack devstack@n-super-cond.service. Sep 15 02:54:05.503976 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_db.sqlalchemy.engines [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 02:54:05.576424 chdv-809057-1 nova-conductor[100487]: DEBUG nova.context [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57101796-6279-447c-b7ae-3a6223f12f96(cell1) {{(pid=100487) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 02:54:05.580425 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_concurrency.lockutils [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 02:54:05.581982 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_concurrency.lockutils [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 02:54:05.582877 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_concurrency.lockutils [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 02:54:05.584804 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_concurrency.lockutils [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 02:54:05.601941 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_db.sqlalchemy.engines [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 02:54:05.602838 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_db.sqlalchemy.engines [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 02:54:05.933285 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_concurrency.lockutils [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Acquired lock "singleton_lock" {{(pid=100487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 15 02:54:05.933933 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_concurrency.lockutils [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Releasing lock "singleton_lock" {{(pid=100487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 15 02:54:05.934801 chdv-809057-1 nova-conductor[100487]: INFO oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Starting 2 workers Sep 15 02:54:05.939733 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Started child 101395 {{(pid=100487) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 15 02:54:05.944498 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Started child 101396 {{(pid=100487) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 15 02:54:05.945699 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Full set of CONF: {{(pid=100487) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Sep 15 02:54:05.946013 chdv-809057-1 nova-conductor[101395]: INFO nova.service [-] Starting conductor node (version 23.1.0) Sep 15 02:54:05.946515 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ******************************************************************************** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 02:54:05.946661 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] Configuration options gathered from: {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 02:54:05.947123 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 02:54:05.948574 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] config files: ['/etc/nova/nova.conf'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 02:54:05.949010 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ================================================================================ {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 02:54:05.949817 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] allow_resize_to_same_host = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.950375 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] arq_binding_timeout = 300 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.950903 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] block_device_allocate_retries = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.951555 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] block_device_allocate_retries_interval = 3 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.952172 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cert = self.pem {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.953478 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute_driver = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.959699 chdv-809057-1 nova-conductor[101396]: INFO nova.service [-] Starting conductor node (version 23.1.0) Sep 15 02:54:05.960927 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute_monitors = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.961750 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] config_dir = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.962352 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] config_drive_format = iso9660 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.963802 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.964159 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] config_source = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.964662 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] console_host = chdv-809057-1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.965187 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] control_exchange = nova {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.965735 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cpu_allocation_ratio = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.966243 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] daemon = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.966757 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] debug = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.967249 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] default_access_ip_network_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.971318 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] default_availability_zone = nova {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.971318 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] default_ephemeral_format = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.971318 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.972521 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] default_schedule_zone = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.973053 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] disk_allocation_ratio = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.973578 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_db.sqlalchemy.engines [None req-38ce2e12-c3a5-40df-9afa-9ca30d6ad257 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 02:54:05.974111 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] enable_new_services = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.987007 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] enabled_apis = ['osapi_compute'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.987626 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] enabled_ssl_apis = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.988157 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] flat_injected = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.988682 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] force_config_drive = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.989184 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] force_raw_images = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.989748 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] graceful_shutdown_timeout = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.990247 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] heal_instance_info_cache_interval = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.991113 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] host = chdv-809057-1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.997539 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.998088 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] initial_disk_allocation_ratio = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.998619 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] initial_ram_allocation_ratio = 1.5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:05.999260 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.002635 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] instance_build_timeout = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.003176 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] instance_delete_interval = 300 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.003726 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] instance_format = [instance: %(uuid)s] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.004315 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] instance_name_template = instance-%08x {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.004845 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] instance_usage_audit = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.006813 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] instance_usage_audit_period = month {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.007340 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.007896 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] instances_path = /opt/stack/data/nova/instances {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.008411 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] internal_service_availability_zone = internal {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.013769 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] key = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.013769 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] live_migration_retry_count = 30 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.013769 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] log_config_append = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.013769 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.013769 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] log_dir = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.013769 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] log_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.013769 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] log_options = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.014374 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] log_rotate_interval = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.014374 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] log_rotate_interval_type = days {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.015682 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_db.sqlalchemy.engines [None req-88dcfa57-a70c-4eda-80bf-6de114217fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 02:54:06.016750 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] log_rotation_type = none {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.017199 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.017652 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.018160 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.018698 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.022033 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.022033 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] long_rpc_timeout = 1800 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.022033 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] max_concurrent_builds = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.023194 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] max_concurrent_live_migrations = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.024035 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] max_concurrent_snapshots = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.025013 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] max_local_block_devices = 3 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.026934 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] max_logfile_count = 30 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.029402 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] max_logfile_size_mb = 200 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.035107 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] maximum_instance_delete_attempts = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.035850 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] metadata_listen = 0.0.0.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.036564 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] metadata_listen_port = 8775 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.037075 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] metadata_workers = 2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.037582 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] migrate_max_retries = -1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.038106 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] mkisofs_cmd = genisoimage {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.038694 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] my_block_storage_ip = 10.222.0.18 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.039127 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] my_ip = 10.222.0.18 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.039646 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] network_allocate_retries = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.040171 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.040679 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] osapi_compute_listen = 0.0.0.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.043010 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] osapi_compute_listen_port = 8774 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.043576 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] osapi_compute_unique_server_name_scope = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.044091 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] osapi_compute_workers = 2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.044603 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] password_length = 12 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.045095 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] periodic_enable = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.045582 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] periodic_fuzzy_delay = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.046275 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] pointer_model = usbtablet {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.046945 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] preallocate_images = none {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.047930 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] publish_errors = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.047930 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] pybasedir = /opt/stack/nova {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058234 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ram_allocation_ratio = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058234 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] rate_limit_burst = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058234 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] rate_limit_except_level = CRITICAL {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058234 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] rate_limit_interval = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058234 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] reboot_timeout = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058234 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] reclaim_instance_interval = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058234 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] record = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058748 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] report_interval = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058748 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] rescue_timeout = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058748 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] reserved_host_cpus = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058748 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] reserved_host_disk_mb = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058748 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] reserved_host_memory_mb = 512 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058748 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] reserved_huge_pages = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.058748 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] resize_confirm_window = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.059270 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] resize_fs_using_block_device = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.059270 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] resume_guests_state_on_host_boot = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.059270 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.059270 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] rpc_response_timeout = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.059270 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] run_external_periodic_tasks = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.059270 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] running_deleted_instance_action = reap {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.059270 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] running_deleted_instance_poll_interval = 1800 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.059845 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] running_deleted_instance_timeout = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.060015 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler_instance_sync_interval = 120 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.060529 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_down_time = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.061044 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] servicegroup_driver = db {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.061545 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] shelved_offload_time = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.062205 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] shelved_poll_interval = 3600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.062730 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] shutdown_timeout = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.063218 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] source_is_ipv6 = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.063724 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ssl_only = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.064221 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] state_path = /opt/stack/data/nova {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.064799 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] sync_power_state_interval = 600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.065186 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] sync_power_state_pool_size = 1000 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.065688 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] syslog_log_facility = LOG_USER {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.066362 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] tempdir = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.066856 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] timeout_nbd = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.067361 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] transport_url = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.067895 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] update_resources_interval = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.068396 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] use_cow_images = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.068881 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] use_eventlog = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.069386 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] use_journal = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.069930 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] use_json = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.070423 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] use_rootwrap_daemon = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.071094 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] use_stderr = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.071404 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] use_syslog = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.071936 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vcpu_pin_set = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.073058 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vif_plugging_is_fatal = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.073661 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vif_plugging_timeout = 300 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.074219 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] virt_mkfs = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.074718 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] volume_usage_poll_interval = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.075216 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] watch_log_file = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.075754 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] web = /usr/share/spice-html5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:54:06.076380 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_concurrency.disable_process_locking = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.076912 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.077447 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.077938 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.078454 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.079158 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.079500 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.080086 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.auth_strategy = keystone {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.080595 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.compute_link_prefix = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.081138 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.081646 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.dhcp_domain = novalocal {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.082131 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.enable_instance_password = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.082680 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.glance_link_prefix = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.083176 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.083715 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.084206 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.instance_list_per_project_cells = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.084692 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.list_records_by_skipping_down_cells = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.085178 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.local_metadata_per_cell = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.085694 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.max_limit = 1000 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.086196 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.metadata_cache_expiration = 15 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.086743 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.neutron_default_tenant_id = default {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.087231 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.use_forwarded_for = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.087698 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.use_neutron_default_nets = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.088304 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094372 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094372 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094372 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094372 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.vendordata_dynamic_targets = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094372 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.vendordata_jsonfile_path = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094372 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094808 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.backend = dogpile.cache.memcached {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094808 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.backend_argument = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094808 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.config_prefix = cache.oslo {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094808 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.debug_cache_backend = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094808 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.enabled = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094808 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.expiration_time = 600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.094808 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.memcache_dead_retry = 300 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.095309 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.095309 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.095796 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.memcache_pool_maxsize = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.096301 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.096935 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.097427 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.memcache_socket_timeout = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.097932 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.proxies = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.098416 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.tls_allowed_ciphers = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.098901 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.tls_cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.099427 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.tls_certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.099912 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.tls_enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.100406 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cache.tls_keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.100937 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.auth_section = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.101479 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.auth_type = password {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.101981 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.102528 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.catalog_info = volumev3::publicURL {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.103014 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.103575 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.104084 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.cross_az_attach = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.104576 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.endpoint_template = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.105110 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.http_retries = 3 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.105595 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.106079 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.106593 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.os_region_name = RegionOne {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.107091 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.108131 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cinder.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.108378 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.108856 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.cpu_dedicated_set = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.109483 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.cpu_shared_set = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.110107 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.image_type_exclude_list = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.110697 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.111304 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.max_concurrent_disk_ops = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.111427 chdv-809057-1 nova-conductor[101395]: DEBUG nova.service [None req-38ce2e12-c3a5-40df-9afa-9ca30d6ad257 None None] Creating RPC server for service conductor {{(pid=101395) start /opt/stack/nova/nova/service.py:182}} Sep 15 02:54:06.112039 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.max_disk_devices_to_attach = -1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.112659 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.113272 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.resource_provider_association_refresh = 300 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.113883 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] compute.shutdown_retry_interval = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.114489 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] conductor.workers = 2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.115125 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] console.allowed_origins = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.115739 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] console.ssl_ciphers = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123026 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] console.ssl_minimum_version = default {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123026 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] consoleauth.token_ttl = 600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123026 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123026 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123026 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123026 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.connect_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123026 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.connect_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123535 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.endpoint_override = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123535 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123535 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123535 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.max_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123535 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.min_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123535 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.region_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123535 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.service_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123963 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.service_type = accelerator {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123963 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.123963 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.status_code_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.125186 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.status_code_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.125783 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.126494 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.127085 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] cyborg.version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.127752 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.backend = sqlalchemy {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.128397 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.connection = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.129016 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.connection_debug = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.129625 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.connection_parameters = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.130223 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.connection_recycle_time = 3600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.130864 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.connection_trace = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.131483 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.db_inc_retry_interval = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.132094 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.db_max_retries = 20 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.132695 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.db_max_retry_interval = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.133306 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.db_retry_interval = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.133925 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.max_overflow = 50 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.134530 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.max_pool_size = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.135990 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.max_retries = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.136604 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.mysql_enable_ndb = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.137279 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.137865 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.pool_timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.138484 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.retry_interval = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.139089 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.slave_connection = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.139718 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.sqlite_synchronous = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.140315 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] database.use_db_reconnect = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.140960 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.backend = sqlalchemy {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.141610 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.connection = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.142220 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.connection_debug = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.142828 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.connection_parameters = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.143441 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.connection_recycle_time = 3600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.144033 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.connection_trace = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.144640 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.db_inc_retry_interval = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.145269 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.db_max_retries = 20 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.145943 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.db_max_retry_interval = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.146557 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.db_retry_interval = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.147288 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.max_overflow = 50 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.148103 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.max_pool_size = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.148745 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.max_retries = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.149234 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.mysql_enable_ndb = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.149904 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.150340 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.pool_timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.151265 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.retry_interval = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.151677 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.slave_connection = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.157911 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] api_database.sqlite_synchronous = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.157911 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] devices.enabled_mdev_types = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.157911 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.157911 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ephemeral_storage_encryption.enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.157911 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.157911 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.api_servers = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.157911 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158384 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158384 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158384 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.connect_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158384 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.connect_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158384 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.debug = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158384 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.default_trusted_certificate_ids = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158384 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.enable_certificate_validation = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158794 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.enable_rbd_download = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158794 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.endpoint_override = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158794 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.158794 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.159129 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.max_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.159673 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.min_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.160198 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.num_retries = 3 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.160748 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.rbd_ceph_conf = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.161133 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.rbd_connect_timeout = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.161527 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.rbd_pool = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.161928 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.rbd_user = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.162513 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.region_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.162890 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.service_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.163286 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.service_type = image {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.163697 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.164068 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.status_code_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.164436 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.status_code_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.164824 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.165241 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.165619 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.verify_glance_signatures = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.166774 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] glance.version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.167065 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] guestfs.debug = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.167697 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.config_drive_cdrom = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.168085 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.config_drive_inject_password = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.168468 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.169015 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.enable_instance_metrics_collection = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.169419 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.enable_remotefx = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.169810 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.instances_path_share = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.170200 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.iscsi_initiator_list = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.170575 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.limit_cpu_features = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.170980 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.171363 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.171805 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.power_state_check_timeframe = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.172176 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.172577 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.172954 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.use_multipath_io = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.173452 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.volume_attach_retry_count = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.173876 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.174255 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.vswitch_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.174639 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.175025 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] mks.enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.176072 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.176737 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] image_cache.manager_interval = 2400 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.177130 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] image_cache.precache_concurrency = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.177518 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] image_cache.remove_unused_base_images = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.177905 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.178298 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.178708 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] image_cache.subdirectory_name = _base {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.179221 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.api_max_retries = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.179634 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.api_retry_interval = 2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.180188 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.auth_section = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.180734 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.auth_type = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.181265 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.181852 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.182392 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.182919 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.connect_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.183489 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.connect_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.184005 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.endpoint_override = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.184538 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.185046 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.185569 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.max_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.186101 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.min_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.186619 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.partition_key = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.187147 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.peer_list = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.187690 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.region_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.188229 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.serial_console_state_timeout = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.188704 chdv-809057-1 nova-conductor[101396]: DEBUG nova.service [None req-88dcfa57-a70c-4eda-80bf-6de114217fbd None None] Creating RPC server for service conductor {{(pid=101396) start /opt/stack/nova/nova/service.py:182}} Sep 15 02:54:06.188923 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.service_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.189485 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.service_type = baremetal {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.190006 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.190528 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.status_code_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.191056 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.status_code_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.191606 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.192156 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.192714 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ironic.version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.193324 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.193912 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] key_manager.fixed_key = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.194524 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.195061 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.barbican_api_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.195646 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.barbican_endpoint = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.196203 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.barbican_endpoint_type = public {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.196832 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.barbican_region_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.197427 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.197950 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.198473 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.199011 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.199581 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.200147 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.number_of_retries = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.200693 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.retry_delay = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.201219 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.send_service_user_token = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.201741 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.202266 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.202792 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.verify_ssl = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.203325 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican.verify_ssl_path = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.203875 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican_service_user.auth_section = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.204435 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican_service_user.auth_type = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.204961 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican_service_user.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.205478 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican_service_user.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.206011 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican_service_user.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.206556 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican_service_user.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.207080 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican_service_user.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.207641 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican_service_user.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.208378 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] barbican_service_user.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.208937 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.approle_role_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.209473 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.approle_secret_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.210000 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.210517 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.211038 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.211606 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.212136 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.212696 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.kv_mountpoint = secret {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.213777 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.kv_version = 2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.214310 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.root_token_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.214831 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.215344 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.ssl_ca_crt_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.215894 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.216421 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.use_ssl = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.216976 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.217531 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.218070 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.218604 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.219126 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.connect_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.219674 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.connect_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.220188 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.endpoint_override = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.220720 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.221334 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.221859 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.max_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.222372 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.min_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.222885 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.region_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.223495 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.service_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.224081 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.service_type = identity {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.224656 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.225203 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.status_code_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.225779 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.status_code_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.226358 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.226957 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.227547 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] keystone.version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.228207 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.connection_uri = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.229508 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.cpu_mode = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.230233 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.cpu_model_extra_flags = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.230633 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.cpu_models = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.231038 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.device_detach_attempts = 8 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.231447 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.device_detach_timeout = 20 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.232051 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.disk_cachemodes = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.232652 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.disk_prefix = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.233265 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.enabled_perf_events = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.233862 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.file_backed_memory = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.234452 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.gid_maps = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.234854 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.hw_disk_discard = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.235229 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.hw_machine_type = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.235737 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.images_rbd_ceph_conf = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.236121 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.236526 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.236917 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.images_rbd_glance_store_name = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.237306 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.images_rbd_pool = rbd {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.237717 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.images_type = default {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.238089 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.images_volume_group = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.238466 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.inject_key = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.238845 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.inject_partition = -2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.239225 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.inject_password = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.241439 chdv-809057-1 nova-conductor[101395]: DEBUG nova.service [None req-38ce2e12-c3a5-40df-9afa-9ca30d6ad257 None None] Join ServiceGroup membership for this service conductor {{(pid=101395) start /opt/stack/nova/nova/service.py:199}} Sep 15 02:54:06.241854 chdv-809057-1 nova-conductor[101395]: DEBUG nova.servicegroup.drivers.db [None req-38ce2e12-c3a5-40df-9afa-9ca30d6ad257 None None] DB_Driver: join new ServiceGroup member chdv-809057-1 to the conductor group, service = {{(pid=101395) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Sep 15 02:54:06.243705 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.iscsi_iface = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.244334 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.iser_use_multipath = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.245053 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_bandwidth = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.245448 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.245841 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_downtime = 500 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.246227 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.246629 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.247007 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_inbound_addr = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.247402 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.248386 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_permit_post_copy = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.248764 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_scheme = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.249176 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_timeout_action = abort {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.249554 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_tunnelled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.250700 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_uri = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.252889 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.live_migration_with_native_tls = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.253315 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.max_queues = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.253727 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.254125 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.nfs_mount_options = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.254651 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.255039 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.255461 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.num_iser_scan_tries = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.255940 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.num_memory_encrypted_guests = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.256537 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.257106 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.num_pcie_ports = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.257634 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.num_volume_scan_tries = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.258170 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.pmem_namespaces = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.258677 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.quobyte_client_cfg = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.259253 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.260031 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rbd_connect_timeout = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.260496 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.260957 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.261402 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rbd_secret_uuid = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.261851 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rbd_user = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.262383 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.262847 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.remote_filesystem_transport = ssh {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.263298 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rescue_image_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.263786 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rescue_kernel_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.264251 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rescue_ramdisk_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.264716 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.265159 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.rx_queue_size = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.265614 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.smbfs_mount_options = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.266341 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.266737 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.snapshot_compression = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.267211 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.snapshot_image_format = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.267626 chdv-809057-1 nova-conductor[101396]: DEBUG nova.service [None req-88dcfa57-a70c-4eda-80bf-6de114217fbd None None] Join ServiceGroup membership for this service conductor {{(pid=101396) start /opt/stack/nova/nova/service.py:199}} Sep 15 02:54:06.267770 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.268287 chdv-809057-1 nova-conductor[101396]: DEBUG nova.servicegroup.drivers.db [None req-88dcfa57-a70c-4eda-80bf-6de114217fbd None None] DB_Driver: join new ServiceGroup member chdv-809057-1 to the conductor group, service = {{(pid=101396) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Sep 15 02:54:06.268525 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.sparse_logical_volumes = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.269053 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.swtpm_enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.269612 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.swtpm_group = tss {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.270289 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.swtpm_user = tss {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.270704 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.sysinfo_serial = unique {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.271080 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.tx_queue_size = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.271490 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.uid_maps = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.271922 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.use_virtio_for_bridges = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.272345 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.virt_type = kvm {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.272742 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.volume_clear = zero {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.273123 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.volume_clear_size = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.273511 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.volume_use_multipath = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.273886 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.vzstorage_cache_path = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.274284 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.274679 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.vzstorage_mount_group = qemu {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.275229 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.vzstorage_mount_opts = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.276248 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.276806 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.277209 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.vzstorage_mount_user = stack {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.277600 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.278026 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.auth_section = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.278442 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.auth_type = password {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.278818 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.279196 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.279604 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.279977 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.connect_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.280454 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.connect_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.280848 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.default_floating_pool = public {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.281225 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.endpoint_override = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.281603 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.extension_sync_interval = 600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.282012 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.http_retries = 3 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.282394 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.282764 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.283135 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.max_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.283555 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.283928 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.min_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.284323 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.ovs_bridge = br-int {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.284693 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.physnets = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.285080 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.region_name = RegionOne {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.285481 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.service_metadata_proxy = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.285856 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.service_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.286254 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.service_type = network {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.286631 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.287023 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.status_code_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.287420 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.status_code_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.287887 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.288300 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.288675 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] neutron.version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.289062 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] notifications.bdms_in_notifications = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.289462 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] notifications.default_level = INFO {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.289857 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] notifications.notification_format = unversioned {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.290368 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] notifications.notify_on_state_change = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.290650 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.291684 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] pci.alias = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.292094 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] pci.passthrough_whitelist = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.292521 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.auth_section = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.292933 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.auth_type = password {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.293339 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.auth_url = http://10.222.0.18/identity {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.293721 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.294095 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.294476 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.294847 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.connect_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.295220 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.connect_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.295641 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.default_domain_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.296020 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.default_domain_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.296393 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.domain_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.296850 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.domain_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.297228 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.endpoint_override = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.297608 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.297979 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.298350 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.max_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.298721 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.min_version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.299103 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.password = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.299571 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.project_domain_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.299960 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.project_domain_name = Default {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.300364 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.project_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.300744 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.project_name = service {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.301128 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.region_name = RegionOne {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.301756 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.service_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.302149 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.service_type = placement {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.302525 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.302891 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.status_code_retries = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.303260 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.status_code_retry_delay = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.303656 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.system_scope = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.304024 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.304392 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.trust_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.304840 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.user_domain_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.305221 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.user_domain_name = Default {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.305522 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.user_id = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.305916 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.username = placement {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.306319 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.306741 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] placement.version = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.307143 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] powervm.disk_driver = localdisk {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.307553 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] powervm.proc_units_factor = 0.1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.307987 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] powervm.volume_group_name = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.308406 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.cores = 20 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.308779 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.count_usage_from_placement = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.309174 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.309583 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.injected_file_content_bytes = 10240 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.309968 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.injected_file_path_length = 255 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.310356 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.injected_files = 5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.310771 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.instances = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.311119 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.key_pairs = 100 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.311532 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.metadata_items = 128 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.311915 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.ram = 51200 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.312291 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.recheck_quota = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.312675 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.server_group_members = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.313056 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] quota.server_groups = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.313446 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] rdp.enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.314075 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.314504 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.314945 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.315317 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.image_metadata_prefilter = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.315747 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.316127 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.max_attempts = 3 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.316510 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.max_placement_results = 1000 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.316887 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.317272 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.query_placement_for_availability_zone = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.317652 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.query_placement_for_image_type_support = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.318029 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.318420 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] scheduler.workers = 2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.318828 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.319220 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.319675 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.320117 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.320520 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.320908 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.321286 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.321721 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.322109 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.host_subset_size = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.322527 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.322912 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.323306 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.isolated_hosts = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.323726 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.isolated_images = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.324102 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.324473 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.324909 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.325220 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.325682 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.325975 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.326352 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.326735 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.327143 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.track_instance_changes = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.327581 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.327970 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] metrics.required = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.328353 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] metrics.weight_multiplier = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.328733 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.329110 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] metrics.weight_setting = [] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.329701 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.330079 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] serial_console.enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.330494 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] serial_console.port_range = 10000:20000 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.330929 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.331285 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.331706 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] serial_console.serialproxy_port = 6083 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.332095 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.auth_section = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.332487 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.auth_type = password {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.332862 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.333241 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.333618 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.333993 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.334361 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.334746 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.send_service_user_token = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.335196 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.335605 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] service_user.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.335995 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] spice.agent_enabled = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.336313 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] spice.enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.336928 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.337366 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.337754 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] spice.html5proxy_port = 6082 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.338675 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] spice.server_listen = 127.0.0.1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.339069 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.339491 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] upgrade_levels.baseapi = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.339871 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] upgrade_levels.cert = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.340261 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] upgrade_levels.compute = auto {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.340633 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] upgrade_levels.conductor = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.341027 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] upgrade_levels.scheduler = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.341404 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vendordata_dynamic_auth.auth_section = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.341781 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vendordata_dynamic_auth.auth_type = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.342149 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vendordata_dynamic_auth.cafile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.342521 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vendordata_dynamic_auth.certfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.342930 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.343295 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vendordata_dynamic_auth.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.343688 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vendordata_dynamic_auth.keyfile = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.344070 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.344437 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vendordata_dynamic_auth.timeout = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.344877 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.api_retry_count = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.345307 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.ca_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.345621 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.cache_prefix = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.346062 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.cluster_name = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.346366 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.connection_pool_size = 10 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.346781 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.console_delay_seconds = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.347149 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.datastore_regex = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.347553 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.host_ip = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.347929 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.host_password = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.348312 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.host_port = 443 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.348680 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.host_username = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.349052 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.insecure = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.349419 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.integration_bridge = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.349795 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.maximum_objects = 100 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.350165 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.pbm_default_policy = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.350541 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.pbm_enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.350914 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.pbm_wsdl_location = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.351333 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.351768 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.serial_port_proxy_uri = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.352197 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.serial_port_service_uri = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.352582 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.task_poll_interval = 0.5 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.352969 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.use_linked_clone = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.353350 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.vnc_keymap = en-us {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.354361 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.vnc_port = 5900 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.354887 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vmware.vnc_port_total = 10000 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.355349 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.auth_schemes = ['none'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.355754 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.enabled = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.356372 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.356774 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.357164 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.novncproxy_port = 6080 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.357580 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.server_listen = 127.0.0.1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.357988 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.358386 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.vencrypt_ca_certs = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.358764 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.vencrypt_client_cert = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.359137 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] vnc.vencrypt_client_key = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.359569 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.359952 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.360337 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.360713 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.disable_rootwrap = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.361089 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.enable_numa_live_migration = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.361465 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.361841 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.362216 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.libvirt_disable_apic = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.362627 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.363006 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.363477 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.363833 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.client_socket_timeout = 900 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.364228 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.default_pool_size = 1000 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.364617 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.keep_alive = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.364998 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.max_header_line = 16384 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.365376 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.secure_proxy_ssl_header = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.365769 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.ssl_ca_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.366154 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.ssl_cert_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.366531 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.ssl_key_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.366914 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.tcp_keepidle = 600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.367455 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.367846 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] zvm.ca_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.368223 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] zvm.cloud_connector_url = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.368712 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.369136 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] zvm.reachable_timeout = 300 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.369843 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.enforce_new_defaults = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.370241 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.enforce_scope = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.370666 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.policy_default_rule = default {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.371075 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.371551 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.policy_file = policy.yaml {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.371941 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.372316 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.372708 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.373098 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.373483 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.373902 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.374334 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.connection_string = messaging:// {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.374738 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.enabled = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.375150 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.es_doc_type = notification {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.375561 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.es_scroll_size = 10000 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.375951 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.es_scroll_time = 2m {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.376326 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.filter_error_trace = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.376717 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.hmac_keys = SECRET_KEY {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.377104 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.sentinel_service_name = mymaster {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.377604 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.socket_timeout = 0.1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.377862 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] profiler.trace_sqlalchemy = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.378271 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] remote_debug.host = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.378639 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] remote_debug.port = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.379057 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.379518 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.379906 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.380281 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.380664 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.381060 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.381445 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.381889 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.382471 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.383081 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.383549 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.384005 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.384412 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.385338 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.385857 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.386248 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.386650 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.386999 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.387411 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.387792 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.388179 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.388571 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.ssl = False {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.388967 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.389383 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.389776 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.390190 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_rabbit.ssl_version = {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.390628 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.391012 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_notifications.retry = -1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.391462 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.391859 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_messaging_notifications.transport_url = **** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.392285 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_reports.file_event_handler = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.392682 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.393053 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] oslo_reports.log_dir = None {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:54:06.393369 chdv-809057-1 nova-conductor[100487]: DEBUG oslo_service.service [None req-ed605b42-3486-44c2-8cb9-75d7df73d968 None None] ******************************************************************************** {{(pid=100487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 02:57:06.161358 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 02:57:06.252392 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 02:57:07.187572 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44726. Sep 15 02:57:07.275304 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44728. Sep 15 03:00:07.180803 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:00:07.269767 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:00:08.201982 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44802. Sep 15 03:00:08.289247 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44804. Sep 15 03:03:08.198097 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:03:08.285941 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:03:09.221812 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44924. Sep 15 03:03:09.309704 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44926. Sep 15 03:03:25.775283 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_db.sqlalchemy.engines [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Parent process 100487 forked (101395) with an open database connection, which is being discarded and recreated. {{(pid=101395) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Sep 15 03:03:26.887370 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Took 1.09 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:03:26.938447 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:26.943164 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:26.952541 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_db.sqlalchemy.engines [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 03:03:27.324057 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:27.327977 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:27.329115 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:27.330786 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:27.348828 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_db.sqlalchemy.engines [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 03:03:27.386787 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Getting quotas for project eb5826b1aa6146daa8c4ca036f5e2666. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:03:27.393070 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Getting quotas for user 1421a61c1ce84da388888e78e7a47918 and project eb5826b1aa6146daa8c4ca036f5e2666. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:03:27.404485 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] [instance: bfd77e4b-bcfe-4763-ab28-dec3a4a284c7] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:03:27.405896 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:27.406401 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:27.486563 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] [instance: bfd77e4b-bcfe-4763-ab28-dec3a4a284c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:03:27.489212 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:27.489620 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:27.774796 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:27.775596 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:27.781043 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cf4ed8b3-6c76-46e8-a9a6-3ed3157edf98 tempest-AggregatesAdminTestJSON-499282105 tempest-AggregatesAdminTestJSON-499282105-project] Acquired lock "compute-rpcapi-router" {{(pid=101395) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 15 03:03:27.786181 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1d789ac0-ee1e-4b8e-beb6-c51c3a42b6f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:27.786831 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1d789ac0-ee1e-4b8e-beb6-c51c3a42b6f2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:27.787900 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1d789ac0-ee1e-4b8e-beb6-c51c3a42b6f2 None None] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:27.790248 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1d789ac0-ee1e-4b8e-beb6-c51c3a42b6f2 None None] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:27.818493 chdv-809057-1 nova-conductor[101395]: INFO nova.compute.rpcapi [None req-1d789ac0-ee1e-4b8e-beb6-c51c3a42b6f2 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 15 03:03:27.819398 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1d789ac0-ee1e-4b8e-beb6-c51c3a42b6f2 None None] Releasing lock "compute-rpcapi-router" {{(pid=101395) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 15 03:03:42.218418 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_db.sqlalchemy.engines [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Parent process 100487 forked (101396) with an open database connection, which is being discarded and recreated. {{(pid=101396) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Sep 15 03:03:43.009623 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:03:43.055508 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.058521 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.067244 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_db.sqlalchemy.engines [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 03:03:43.381658 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.383273 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.384405 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.384989 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.401460 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_db.sqlalchemy.engines [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 03:03:43.435690 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Getting quotas for project 07957097b0974638a6567462df96ed6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:03:43.449947 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Getting quotas for user 7407474cc940413c81445bcff7d76560 and project 07957097b0974638a6567462df96ed6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:03:43.469313 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] [instance: 0ecd983e-f872-4b1e-bf03-4432cc4b8dcc] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:03:43.469313 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.469313 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.574527 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] [instance: 0ecd983e-f872-4b1e-bf03-4432cc4b8dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:03:43.577226 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.577634 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.733749 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:03:43.761487 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.761894 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.847621 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.848293 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.849021 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cc92c45d-ba50-4b69-b998-8a0ca732fadd tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Acquired lock "compute-rpcapi-router" {{(pid=101396) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 15 03:03:43.850495 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2c7772b2-1552-47b5-b324-374b2a067f7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.851125 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2c7772b2-1552-47b5-b324-374b2a067f7f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.852427 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2c7772b2-1552-47b5-b324-374b2a067f7f None None] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.853027 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2c7772b2-1552-47b5-b324-374b2a067f7f None None] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.874900 chdv-809057-1 nova-conductor[101396]: INFO nova.compute.rpcapi [None req-2c7772b2-1552-47b5-b324-374b2a067f7f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 15 03:03:43.876154 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2c7772b2-1552-47b5-b324-374b2a067f7f None None] Releasing lock "compute-rpcapi-router" {{(pid=101396) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 15 03:03:43.977279 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.977836 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.979057 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:43.979623 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:43.996789 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Getting quotas for project 5bdda489d0b04c92b4955f83049edf4e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:03:44.002217 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Getting quotas for user 6d6003cd23424421badac516487c4b69 and project 5bdda489d0b04c92b4955f83049edf4e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:03:44.012436 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] [instance: ad99e741-29d4-4ccd-b301-a8b772ce8532] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:03:44.013293 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:44.018536 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:44.085935 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] [instance: ad99e741-29d4-4ccd-b301-a8b772ce8532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:03:44.087596 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:44.088293 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:03:44.342152 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:03:44.342584 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6417e7e-dfc0-43ba-a021-4b51980c3194 tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:01.700872 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:01.728400 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:01.729171 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:01.931567 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:01.932509 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:01.933680 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:01.934230 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:01.955061 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Getting quotas for project fe352cc39d754702b20b3e15ec785413. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:01.959891 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Getting quotas for user 96bac47cfb584e829f3d37514b81b906 and project fe352cc39d754702b20b3e15ec785413. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:01.973272 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] [instance: f3f35c0d-db34-4d5c-9e99-22ee0c871c27] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:01.974741 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:01.975281 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:02.034184 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] [instance: f3f35c0d-db34-4d5c-9e99-22ee0c871c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:02.035747 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:02.036247 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:02.299020 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:02.299551 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d6a62c24-0e5b-46c0-81f9-884ec63e3a5c tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:03.175982 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:03.204696 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:03.205244 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:03.377589 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:03.378158 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:03.379561 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:03.380284 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:03.408985 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Getting quotas for project fe352cc39d754702b20b3e15ec785413. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:03.415319 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Getting quotas for user 96bac47cfb584e829f3d37514b81b906 and project fe352cc39d754702b20b3e15ec785413. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:03.437170 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] [instance: 06d71382-3042-48d8-b980-14d2a9de0666] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:03.438342 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:03.438754 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:03.567562 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] [instance: 06d71382-3042-48d8-b980-14d2a9de0666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:03.569391 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:03.570132 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:03.942201 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:03.942618 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b6f167fe-a140-4317-92e8-0de5ca62fcca tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:15.635288 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-91f51161-1ff7-404d-a771-7f5b27d091cc tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:04:15.635910 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91f51161-1ff7-404d-a771-7f5b27d091cc tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:15.636182 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91f51161-1ff7-404d-a771-7f5b27d091cc tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:16.570008 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-91f51161-1ff7-404d-a771-7f5b27d091cc tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Created allocations for migration a9ba91b2-f587-49b2-ba42-a638a9250bf4 on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:04:16.912764 chdv-809057-1 nova-conductor[101396]: DEBUG nova.scheduler.utils [None req-91f51161-1ff7-404d-a771-7f5b27d091cc tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] [instance: 0ecd983e-f872-4b1e-bf03-4432cc4b8dcc] Instance allocations successfully created on destination node 4304e6a0-cb35-42bf-878b-c4da5dd28abd: {'allocations': {'4304e6a0-cb35-42bf-878b-c4da5dd28abd': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101396) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:842}} Sep 15 03:04:16.914150 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-91f51161-1ff7-404d-a771-7f5b27d091cc tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lazy-loading 'resources' on Instance uuid 0ecd983e-f872-4b1e-bf03-4432cc4b8dcc {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:04:16.925236 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-91f51161-1ff7-404d-a771-7f5b27d091cc tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lazy-loading 'pci_requests' on Instance uuid 0ecd983e-f872-4b1e-bf03-4432cc4b8dcc {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:04:17.760207 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.live_migrate [None req-91f51161-1ff7-404d-a771-7f5b27d091cc tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] [instance: 0ecd983e-f872-4b1e-bf03-4432cc4b8dcc] Start binding ports on destination host: chh2-809057-1 {{(pid=101396) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:386}} Sep 15 03:04:18.149347 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:18.180191 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:18.180896 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:18.430314 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:18.431062 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:18.432280 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:18.434128 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:18.458925 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:18.464240 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for user 072df3f3b0b64d858b391f7da54bf6ff and project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:18.496506 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: 0fdf496e-ffd0-4dfe-bc24-de5a2790c124] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:18.500441 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:18.501188 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:18.638539 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: 0fdf496e-ffd0-4dfe-bc24-de5a2790c124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:18.639799 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:18.640198 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:19.054536 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:19.055141 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1315689e-1589-43c6-9812-2616bb80c304 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:22.070376 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:22.095782 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:22.096185 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:22.245681 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:22.246093 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:22.246806 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:22.247197 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:22.262427 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Getting quotas for project 5bdda489d0b04c92b4955f83049edf4e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:22.265762 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Getting quotas for user 6d6003cd23424421badac516487c4b69 and project 5bdda489d0b04c92b4955f83049edf4e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:22.276335 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] [instance: 7c8e2af3-ac59-4137-a99f-1c83c02f55f9] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:22.277285 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:22.278213 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:22.376622 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] [instance: 7c8e2af3-ac59-4137-a99f-1c83c02f55f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:22.377890 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:22.378697 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:22.646007 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:22.646878 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cee155cc-fe4f-4705-ab41-3f29a4493aab tempest-DeleteServersAdminTestJSON-897547425 tempest-DeleteServersAdminTestJSON-897547425-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:30.758484 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:30.794974 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:30.795654 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:30.952098 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:30.959562 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:30.960735 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:30.961387 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:30.991819 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Getting quotas for project fe352cc39d754702b20b3e15ec785413. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:31.004605 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Getting quotas for user 96bac47cfb584e829f3d37514b81b906 and project fe352cc39d754702b20b3e15ec785413. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:31.016341 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] [instance: 2755606f-e0ca-4e1f-9b8b-0f893662b07a] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:31.017858 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:31.018271 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:31.115045 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] [instance: 2755606f-e0ca-4e1f-9b8b-0f893662b07a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:31.116558 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:31.116991 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:31.377556 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:31.378137 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9bf25903-377e-4981-8917-cf87f3fdd372 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:41.772429 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:41.800409 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:41.800936 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:41.930613 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:41.931028 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:41.931793 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:41.932189 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:41.949104 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Getting quotas for project 07957097b0974638a6567462df96ed6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:41.953395 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Getting quotas for user 7407474cc940413c81445bcff7d76560 and project 07957097b0974638a6567462df96ed6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:41.963879 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] [instance: 52d99073-aade-4ff1-b8a4-2eb36a8ea295] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:41.964814 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:41.965395 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:42.035410 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] [instance: 52d99073-aade-4ff1-b8a4-2eb36a8ea295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:42.038093 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:42.038501 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:42.322883 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:42.323287 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22415610-6db6-4e3f-9d14-3504ab32d758 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:43.906863 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:43.908358 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:44.797158 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Took 0.79 seconds to select destinations for 2 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:44.828160 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:44.828787 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:44.977160 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:44.977819 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.018866 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:45.045558 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.046140 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.123310 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.123843 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.124799 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.125257 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.143307 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:45.147747 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for user 072df3f3b0b64d858b391f7da54bf6ff and project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:45.159016 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: 616e96f0-3a61-4b34-9e3c-84d421894b42] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:45.160114 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.160585 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.234857 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: 616e96f0-3a61-4b34-9e3c-84d421894b42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:45.237288 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.237837 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.251449 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.251988 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.252898 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.253424 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.272617 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Getting quotas for project 591e4489260649c480a5fb750326237a. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:45.276476 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Getting quotas for user 4209b644437f4239baea72d0ba2f4fa8 and project 591e4489260649c480a5fb750326237a. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:45.287963 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] [instance: dad481ff-c1cf-422d-8c8a-8e7ce4c95891] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:45.288935 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.289412 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.389241 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] [instance: dad481ff-c1cf-422d-8c8a-8e7ce4c95891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:45.390656 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.392503 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.525562 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.526074 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.553548 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: 1e1e31ec-2707-44a8-80e4-e618bf7a0b28] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:45.554028 chdv-809057-1 nova-conductor[101395]: DEBUG nova.objects.instance_group [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lazy-loading 'hosts' on InstanceGroup uuid dfe7dc1e-e585-4888-a11e-a599c66b7b64 {{(pid=101395) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:356}} Sep 15 03:04:45.585624 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.586038 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.663362 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.664046 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-043e0e42-6f55-4b86-bb9b-03ff6c507afa tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:45.715405 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: 1e1e31ec-2707-44a8-80e4-e618bf7a0b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:45.719524 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:45.719524 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:46.087824 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:46.088543 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-36cd5c38-b861-40dd-8bc7-fd5c236b71e9 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:46.549610 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:46.584639 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:46.585608 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:46.833497 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:46.834150 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:46.835823 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:46.836217 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:46.855721 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Getting quotas for project 5b0b51d9b9394fd388b8c21701ff2deb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:46.860317 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Getting quotas for user 5e698660444f4eb995b98dc5ec1d0903 and project 5b0b51d9b9394fd388b8c21701ff2deb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:46.871646 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] [instance: 605a1ea2-87b7-48d9-b367-fd2aee635d3a] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:46.872824 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:46.873291 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:46.971445 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] [instance: 605a1ea2-87b7-48d9-b367-fd2aee635d3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:46.973260 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:46.973656 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:47.391554 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:47.394061 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9c075310-8062-40b5-802c-55a7f075eadc tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:52.793577 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:04:52.834907 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:52.837530 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:53.105545 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:53.106188 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:53.107444 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:53.109353 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:53.141751 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Getting quotas for project 7d07e868825a43d68ad79c742101cbef. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:04:53.149020 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Getting quotas for user 561ab173e0824daa8aef7715d5406217 and project 7d07e868825a43d68ad79c742101cbef. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:04:53.168641 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] [instance: bde25bc5-80c7-402a-8293-7d8649101a42] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:04:53.176440 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:53.177150 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:53.251716 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] [instance: bde25bc5-80c7-402a-8293-7d8649101a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:04:53.252978 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:53.253385 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:04:53.619306 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:04:53.620019 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6a35ffde-f5ba-4bef-9837-8b8945afadcb tempest-ServerDiagnosticsNegativeTest-37277253 tempest-ServerDiagnosticsNegativeTest-37277253-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:00.853972 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-de62e96a-80dd-42eb-8af8-ff44478b81af tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method rebuild_instance {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:05:00.854661 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-de62e96a-80dd-42eb-8af8-ff44478b81af tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:00.855062 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-de62e96a-80dd-42eb-8af8-ff44478b81af tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:00.979155 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-de62e96a-80dd-42eb-8af8-ff44478b81af tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] [instance: f3f35c0d-db34-4d5c-9e99-22ee0c871c27] No migration record for the rebuild/evacuate request. {{(pid=101396) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1127}} Sep 15 03:05:01.299613 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:05:01.329508 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:01.329908 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:01.564212 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:01.564624 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:01.565364 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:01.565990 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:01.602466 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Getting quotas for project 87a6d3a8c36a47308d4e1861f4b703b5. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:05:01.607043 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Getting quotas for user c61d70fb70a74ab293ef8bb9f85cf6a5 and project 87a6d3a8c36a47308d4e1861f4b703b5. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:05:01.620267 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] [instance: 36477089-51ae-49eb-83b0-3c5c8f4a66af] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:05:01.621711 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:01.622339 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:01.714620 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] [instance: 36477089-51ae-49eb-83b0-3c5c8f4a66af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:05:01.716360 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:01.717044 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:02.013039 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:02.013640 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-556ca213-b06a-41af-a370-a78dffbb7df3 tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:02.286184 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:05:02.305809 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:02.307352 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:02.495253 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:02.496092 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:02.497045 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:02.497764 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:02.516830 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Getting quotas for project 87a6d3a8c36a47308d4e1861f4b703b5. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:05:02.522964 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Getting quotas for user c61d70fb70a74ab293ef8bb9f85cf6a5 and project 87a6d3a8c36a47308d4e1861f4b703b5. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:05:02.534720 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] [instance: da205eee-da57-47bd-b468-f411bb863947] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:05:02.535937 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:02.536486 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:02.604946 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] [instance: da205eee-da57-47bd-b468-f411bb863947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:05:02.606202 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:02.606600 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:02.869744 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:02.870153 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-50bb6f2c-cfe3-4360-aed9-ce58f28ab6ad tempest-ListImageFiltersTestJSON-567914457 tempest-ListImageFiltersTestJSON-567914457-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:04.804274 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6fd9543c-47b4-4af2-a72d-e33f77902d07 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:05:04.805284 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6fd9543c-47b4-4af2-a72d-e33f77902d07 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:04.808347 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6fd9543c-47b4-4af2-a72d-e33f77902d07 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:05.603267 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-6fd9543c-47b4-4af2-a72d-e33f77902d07 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Created allocations for migration 9e8525f5-b291-4595-a51f-4337cc35dfb2 on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:05:05.927732 chdv-809057-1 nova-conductor[101396]: DEBUG nova.scheduler.utils [None req-6fd9543c-47b4-4af2-a72d-e33f77902d07 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] [instance: 52d99073-aade-4ff1-b8a4-2eb36a8ea295] Instance allocations successfully created on destination node 4304e6a0-cb35-42bf-878b-c4da5dd28abd: {'allocations': {'4304e6a0-cb35-42bf-878b-c4da5dd28abd': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101396) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:842}} Sep 15 03:05:05.928318 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-6fd9543c-47b4-4af2-a72d-e33f77902d07 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lazy-loading 'resources' on Instance uuid 52d99073-aade-4ff1-b8a4-2eb36a8ea295 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:05:05.934896 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-6fd9543c-47b4-4af2-a72d-e33f77902d07 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lazy-loading 'pci_requests' on Instance uuid 52d99073-aade-4ff1-b8a4-2eb36a8ea295 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:05:06.900398 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.live_migrate [None req-6fd9543c-47b4-4af2-a72d-e33f77902d07 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] [instance: 52d99073-aade-4ff1-b8a4-2eb36a8ea295] Start binding ports on destination host: chh2-809057-1 {{(pid=101396) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:386}} Sep 15 03:05:18.171935 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:18.173455 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:18.834901 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Took 0.63 seconds to select destinations for 2 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:05:18.875686 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:18.876086 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:19.068684 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:19.069340 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:19.219757 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:19.220441 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:19.220929 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:19.221318 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:19.238691 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:05:19.242302 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for user 072df3f3b0b64d858b391f7da54bf6ff and project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:05:19.253574 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: aa32f024-9284-4eb8-8530-788ba9f54bea] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:05:19.254575 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:19.254975 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:19.336696 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: aa32f024-9284-4eb8-8530-788ba9f54bea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:05:19.336696 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:19.337045 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:19.658152 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:19.658516 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:19.668098 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: d556a23c-a6e8-4b31-a5f1-feeb82a0e00b] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:05:19.668535 chdv-809057-1 nova-conductor[101395]: DEBUG nova.objects.instance_group [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lazy-loading 'hosts' on InstanceGroup uuid b9f210cc-c593-4d85-be04-a3906070db89 {{(pid=101395) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:356}} Sep 15 03:05:19.677222 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:19.677590 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:19.764957 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: d556a23c-a6e8-4b31-a5f1-feeb82a0e00b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:05:19.766413 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:19.766891 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:20.109907 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:20.110359 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-dadf83bf-9086-44fb-afff-1e56d2c20edc tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:27.585465 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:05:27.606408 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:27.606808 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:27.802181 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:27.802501 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:27.803216 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:27.803632 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:27.817979 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Getting quotas for project af3ab50c78884547a5fc9c97604594f1. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:05:27.821633 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Getting quotas for user dbb97f44c7424db2a1e20647e7dbfbcd and project af3ab50c78884547a5fc9c97604594f1. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:05:27.831320 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] [instance: 0aa5f1ee-d047-4b67-b255-8f313bede7d0] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:05:27.832222 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:27.832615 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:27.879414 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] [instance: 0aa5f1ee-d047-4b67-b255-8f313bede7d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:05:27.880793 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:27.881297 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:28.091850 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:28.092166 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f1b66f05-a65c-460f-836d-420029017dd0 tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:33.547260 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:05:33.565355 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:33.565555 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:33.677753 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:33.678264 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:33.679214 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:33.679721 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:33.695556 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Getting quotas for project 5b0b51d9b9394fd388b8c21701ff2deb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:05:33.699770 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Getting quotas for user 5e698660444f4eb995b98dc5ec1d0903 and project 5b0b51d9b9394fd388b8c21701ff2deb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:05:33.711767 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] [instance: d8cd0caf-9fb1-4377-8755-425465966ce3] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:05:33.712683 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:33.713079 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:33.809983 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] [instance: d8cd0caf-9fb1-4377-8755-425465966ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:05:33.812374 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:33.812791 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:34.211645 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:34.212131 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c9690d78-a134-4f86-a25d-2d0bf33f0df9 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:46.053268 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:05:46.068607 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:46.069017 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:46.215484 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:46.215895 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:46.224821 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:46.224821 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:46.232087 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Getting quotas for project af3ab50c78884547a5fc9c97604594f1. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:05:46.236256 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Getting quotas for user dbb97f44c7424db2a1e20647e7dbfbcd and project af3ab50c78884547a5fc9c97604594f1. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:05:46.246042 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] [instance: 71b4c771-0955-451d-8410-e4df10384632] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:05:46.246973 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:46.247392 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:46.330002 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] [instance: 71b4c771-0955-451d-8410-e4df10384632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:05:46.332002 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:46.332002 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:46.582430 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:46.582793 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-588f0103-a7d9-4513-96df-7f365f96660b tempest-LiveMigrationNegativeTest-2081857401 tempest-LiveMigrationNegativeTest-2081857401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:53.797146 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:05:53.816568 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:53.816977 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:53.935429 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:53.936229 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:53.937663 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:53.940908 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:53.956979 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Getting quotas for project 07957097b0974638a6567462df96ed6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:05:53.960712 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Getting quotas for user 7407474cc940413c81445bcff7d76560 and project 07957097b0974638a6567462df96ed6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:05:53.971193 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] [instance: ad79834a-54e7-44d2-ac45-fdaf7b174fb5] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:05:53.972459 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:53.972924 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:54.043875 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] [instance: ad79834a-54e7-44d2-ac45-fdaf7b174fb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:05:54.047094 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:54.047094 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:54.302997 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:54.303455 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7c779f83-d7b4-47ab-8af2-0368dd6e0004 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:59.148429 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5d4c80d8-de43-4f93-8d80-8746ae6ddc75 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method rebuild_instance {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:05:59.150834 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5d4c80d8-de43-4f93-8d80-8746ae6ddc75 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:05:59.152133 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5d4c80d8-de43-4f93-8d80-8746ae6ddc75 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:05:59.215624 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5d4c80d8-de43-4f93-8d80-8746ae6ddc75 tempest-ServersAdminTestJSON-506342061 tempest-ServersAdminTestJSON-506342061-project] [instance: f3f35c0d-db34-4d5c-9e99-22ee0c871c27] No migration record for the rebuild/evacuate request. {{(pid=101396) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1127}} Sep 15 03:06:07.185584 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:06:07.209212 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:07.209917 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:07.337076 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:07.337953 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:07.339609 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:07.340191 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:07.364475 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:06:07.368516 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for user 072df3f3b0b64d858b391f7da54bf6ff and project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:06:07.379884 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: b8f92946-7f9a-4fe3-8fa9-553a3ffdb153] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:06:07.380959 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:07.381366 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:07.442921 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: b8f92946-7f9a-4fe3-8fa9-553a3ffdb153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:06:07.444540 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:07.445260 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:07.685287 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:07.685701 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4249947-c6da-4c72-8ca7-76bd143d046b tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:13.731130 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:06:13.811773 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:13.811773 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:14.017728 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:14.018148 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:14.018867 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:14.019260 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:14.091525 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Getting quotas for project 5b0b51d9b9394fd388b8c21701ff2deb. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:06:14.106004 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Getting quotas for user 5e698660444f4eb995b98dc5ec1d0903 and project 5b0b51d9b9394fd388b8c21701ff2deb. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:06:14.159621 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] [instance: cb967505-3901-4066-9b4f-afe23bb3112f] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:06:14.162352 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:14.164921 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:14.239149 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] [instance: cb967505-3901-4066-9b4f-afe23bb3112f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:06:14.240696 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:14.241409 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:14.520550 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:14.521116 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7fa9b44b-e324-4ed5-bda5-7540c59e6383 tempest-ImagesOneServerNegativeTestJSON-949271713 tempest-ImagesOneServerNegativeTestJSON-949271713-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:20.802840 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:06:20.843310 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:20.843740 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:21.084140 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:21.084140 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:21.084140 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:21.086736 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:21.106710 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Getting quotas for project 72ad2a40ec1349d4ab8f034f2db3f396. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:06:21.110466 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Getting quotas for user fdd5f29809174681b80daad44366437c and project 72ad2a40ec1349d4ab8f034f2db3f396. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:06:21.120571 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] [instance: c2fc8f1e-beed-46e0-845b-91fb8cbd0ef0] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:06:21.127273 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:21.127273 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:21.192083 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] [instance: c2fc8f1e-beed-46e0-845b-91fb8cbd0ef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:06:21.193776 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:21.194655 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:21.445128 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:21.445665 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d4a7c178-9945-419e-8afb-de8695fdad6d tempest-VolumesAdminNegativeTest-83115905 tempest-VolumesAdminNegativeTest-83115905-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:29.141140 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:06:29.178003 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:29.178479 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:29.307749 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:29.308153 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:29.316155 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:29.316155 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:29.336525 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:06:29.340825 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for user 072df3f3b0b64d858b391f7da54bf6ff and project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:06:29.353864 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: b3772b8d-d148-4887-b22f-2c0b171479df] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:06:29.355085 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:29.355798 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:29.426545 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: b3772b8d-d148-4887-b22f-2c0b171479df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:06:29.428197 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:29.429188 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:29.732367 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:29.732880 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a1115ba3-128e-4167-bbc1-981a99f14996 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:36.582481 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-30a0ab6e-8cd1-42ca-bd65-41939cf51a6d tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:06:36.583109 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-30a0ab6e-8cd1-42ca-bd65-41939cf51a6d tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:36.583352 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-30a0ab6e-8cd1-42ca-bd65-41939cf51a6d tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:37.502999 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-30a0ab6e-8cd1-42ca-bd65-41939cf51a6d tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Created allocations for migration b5ba503c-ad13-47db-ab8f-b6ef8cd8ed0f on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:06:37.819596 chdv-809057-1 nova-conductor[101395]: DEBUG nova.scheduler.utils [None req-30a0ab6e-8cd1-42ca-bd65-41939cf51a6d tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] [instance: ad79834a-54e7-44d2-ac45-fdaf7b174fb5] Instance allocations successfully created on destination node 4304e6a0-cb35-42bf-878b-c4da5dd28abd: {'allocations': {'4304e6a0-cb35-42bf-878b-c4da5dd28abd': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101395) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:842}} Sep 15 03:06:37.821644 chdv-809057-1 nova-conductor[101395]: DEBUG nova.objects.instance [None req-30a0ab6e-8cd1-42ca-bd65-41939cf51a6d tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lazy-loading 'resources' on Instance uuid ad79834a-54e7-44d2-ac45-fdaf7b174fb5 {{(pid=101395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:06:37.836789 chdv-809057-1 nova-conductor[101395]: DEBUG nova.objects.instance [None req-30a0ab6e-8cd1-42ca-bd65-41939cf51a6d tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lazy-loading 'pci_requests' on Instance uuid ad79834a-54e7-44d2-ac45-fdaf7b174fb5 {{(pid=101395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:06:38.893097 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.live_migrate [None req-30a0ab6e-8cd1-42ca-bd65-41939cf51a6d tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] [instance: ad79834a-54e7-44d2-ac45-fdaf7b174fb5] Start binding ports on destination host: chh2-809057-1 {{(pid=101395) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:386}} Sep 15 03:06:56.409895 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:06:56.472735 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:56.473150 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:56.718497 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:56.719194 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:56.724345 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:56.724961 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:56.801323 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:06:56.816838 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Getting quotas for user 072df3f3b0b64d858b391f7da54bf6ff and project 7c0f921795264b878147df45a4106c8c. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:06:56.853036 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: 83a32e9e-8f88-4d24-b5a3-c2a157f04fd0] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:06:56.854022 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:56.854430 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:56.940143 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] [instance: 83a32e9e-8f88-4d24-b5a3-c2a157f04fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:06:56.941468 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:56.941877 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:06:57.307399 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:06:57.307834 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-699deceb-6878-4f28-a9dc-c2572cd05844 tempest-ServersOnMultiNodesTest-602267403 tempest-ServersOnMultiNodesTest-602267403-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:16.956230 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:07:17.996817 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51718. Sep 15 03:07:20.476557 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:07:20.529855 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:20.529855 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:20.628469 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:07:20.677730 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:20.678138 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:20.878332 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:20.878743 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:20.882736 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:20.882736 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:20.938781 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Getting quotas for project e790274868214007a72d0d6e4a21e39d. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:07:20.943452 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Getting quotas for user 7ecdce97524b4526bf6b26ef11540f9a and project e790274868214007a72d0d6e4a21e39d. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:07:20.962118 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] [instance: 22d184e4-2400-4e5a-bf5c-a2e1f33859f5] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:07:20.963333 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:20.963954 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:21.074268 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:21.076354 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:21.077307 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:21.078065 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] [instance: 22d184e4-2400-4e5a-bf5c-a2e1f33859f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e02460a2-0862-4dc9-9e53-34f3e422f772',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:07:21.079689 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:21.080387 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:21.081291 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:21.121986 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Getting quotas for project 494c00b2979d4135827fcbf7ddf1f404. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:07:21.131613 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Getting quotas for user 8da91980c6ba42ec99fd24ccc1727e64 and project 494c00b2979d4135827fcbf7ddf1f404. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:07:21.156710 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] [instance: dffe821a-1639-4e51-87cb-1f58ef3a8092] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:07:21.158937 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:21.163270 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:21.254718 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] [instance: dffe821a-1639-4e51-87cb-1f58ef3a8092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:07:21.258462 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:21.259032 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:21.336480 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:21.337337 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b03725cf-eb67-480c-9e3f-2d34ef891aee tempest-AttachSCSIVolumeTestJSON-1933681957 tempest-AttachSCSIVolumeTestJSON-1933681957-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:21.502080 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:21.502676 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-51e5b15f-4043-493d-8c1b-5a392867a9d2 tempest-TenantUsagesTestJSON-1883834539 tempest-TenantUsagesTestJSON-1883834539-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:40.373502 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:07:40.397929 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:40.399168 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:40.657610 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:40.660330 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:40.660330 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:40.660330 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:40.679839 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Getting quotas for project 1114aeba0097452cbe55f38de5ba436c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:07:40.684029 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Getting quotas for user 0698a029c2264e4d9ee4420ff57a3440 and project 1114aeba0097452cbe55f38de5ba436c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:07:40.694521 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] [instance: b4ca40bc-7674-40e5-bc5d-037db75760ff] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:07:40.695888 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:40.696522 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:40.756185 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] [instance: b4ca40bc-7674-40e5-bc5d-037db75760ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:07:40.757435 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:40.757843 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:07:41.001538 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:07:41.001538 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-848d38db-a886-4f9c-861e-7e486b54dde4 tempest-ServersTestJSON-1034487679 tempest-ServersTestJSON-1034487679-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:07.985426 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:08:08.015946 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:08.016688 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:08.324008 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:08.324471 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:08.325749 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:08.326213 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:08.343109 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:08:08.347681 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for user 7758dc3f6f304d72a379df79f1e7e403 and project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:08:08.357876 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 28c26965-0ea8-404e-9308-a8b832297519] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:08:08.358807 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:08.359204 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:08.453102 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 28c26965-0ea8-404e-9308-a8b832297519] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:08:08.454469 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:08.454882 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:08.767296 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:08.767736 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-20a8831e-33f0-4c15-afb0-d5fb62b50c5a tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:19.505160 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:08:19.531595 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:19.532137 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:19.725926 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:19.726576 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:19.728298 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:19.729122 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:19.757998 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Getting quotas for project 591e4489260649c480a5fb750326237a. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:08:19.763689 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Getting quotas for user 4209b644437f4239baea72d0ba2f4fa8 and project 591e4489260649c480a5fb750326237a. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:08:19.779225 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] [instance: c91f73ff-3e83-4540-ad98-5ddf2cb5b4be] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:08:19.780934 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:19.781420 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:19.888174 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] [instance: c91f73ff-3e83-4540-ad98-5ddf2cb5b4be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:08:19.892170 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:19.892170 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:19.990565 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:19.991347 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:20.341590 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:20.342078 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0286b153-efd5-4417-931d-66bd1cc7e0ca tempest-ServersWithSpecificFlavorTestJSON-1405364026 tempest-ServersWithSpecificFlavorTestJSON-1405364026-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:21.029463 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:08:34.703731 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:08:34.732927 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:34.736782 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:34.892228 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:34.892228 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:34.892228 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:34.893014 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:34.917403 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:08:34.922411 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for user 7758dc3f6f304d72a379df79f1e7e403 and project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:08:34.934571 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 9f4ac371-52c5-434e-9639-508ce716aaca] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:08:34.935863 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:34.936367 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:35.048142 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 9f4ac371-52c5-434e-9639-508ce716aaca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:08:35.049887 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:35.050763 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:35.496049 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:35.496776 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7e11b50e-695c-47d7-9f36-bd2e295d666d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:39.082094 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:08:39.143069 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:39.143069 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:39.521141 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:39.523173 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:39.526173 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:39.526581 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:39.601157 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Getting quotas for project 25f138fc674a47429a5645b2b0e92e43. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:08:39.611075 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Getting quotas for user 19ccbb43b9de4a0b90cf4345f09501b6 and project 25f138fc674a47429a5645b2b0e92e43. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:08:39.617503 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] [instance: b742662b-e7ae-470b-bdf8-399ffe8e1ceb] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:08:39.618524 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:39.618976 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:39.784355 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] [instance: b742662b-e7ae-470b-bdf8-399ffe8e1ceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:08:39.786187 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:39.786768 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:40.130353 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Took 1.10 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:08:40.169906 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:40.170835 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:40.192558 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:40.193568 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-968c6c90-7f4d-4699-9d54-1cdb547a6291 tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:40.596534 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:40.598818 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:40.599770 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:40.604415 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:40.628534 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Getting quotas for project 73e24f0984214725af11c13c6c29d80c. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:08:40.632450 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Getting quotas for user 91b36fa31842406586fa8a2cd096ea71 and project 73e24f0984214725af11c13c6c29d80c. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:08:40.676751 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] [instance: 11deb62a-a45f-4316-a74f-5c474b779003] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:08:40.679313 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:40.681102 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:40.812669 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] [instance: 11deb62a-a45f-4316-a74f-5c474b779003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:08:40.813879 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:40.814773 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:41.440896 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:41.440896 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b1c912f0-5b31-4b90-8cf7-d70344f324b7 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:48.649905 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:08:48.669505 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:48.669919 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:48.793664 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:48.794217 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:48.795034 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:48.795559 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:48.812953 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Getting quotas for project 07957097b0974638a6567462df96ed6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:08:48.817086 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Getting quotas for user 7407474cc940413c81445bcff7d76560 and project 07957097b0974638a6567462df96ed6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:08:48.830903 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] [instance: 6f130b21-01d3-4599-8edf-0d4755e3c98b] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:08:48.832169 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:48.832760 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:48.953157 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] [instance: 6f130b21-01d3-4599-8edf-0d4755e3c98b] block_device_mapping [BlockDeviceMapping(attachment_id=54c68fbd-4d53-4b5e-aee1-dae1bc6e7f85,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='898679e3-01e5-4bbc-96c2-dbd184910a0d',volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:08:48.956168 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:48.956168 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:49.658122 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:49.660477 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3c6cb9e4-2218-4e9b-a172-f426468cdc10 tempest-LiveMigrationTest-403328955 tempest-LiveMigrationTest-403328955-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:57.507916 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:08:57.527795 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:57.528463 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:57.546121 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-3f56f5a0-4396-4c59-b3ec-435639f7fb64 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method rebuild_instance {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:08:57.546947 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3f56f5a0-4396-4c59-b3ec-435639f7fb64 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:57.547599 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3f56f5a0-4396-4c59-b3ec-435639f7fb64 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:57.643757 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-3f56f5a0-4396-4c59-b3ec-435639f7fb64 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] [instance: 11deb62a-a45f-4316-a74f-5c474b779003] No migration record for the rebuild/evacuate request. {{(pid=101395) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1127}} Sep 15 03:08:57.689658 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:57.691878 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:57.694107 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:57.695928 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:57.730582 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Getting quotas for project 25f138fc674a47429a5645b2b0e92e43. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:08:57.735007 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Getting quotas for user 19ccbb43b9de4a0b90cf4345f09501b6 and project 25f138fc674a47429a5645b2b0e92e43. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:08:57.748424 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] [instance: cdc68752-4132-4b56-b9df-a9e145400fe0] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:08:57.749515 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:57.750011 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:57.829500 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] [instance: cdc68752-4132-4b56-b9df-a9e145400fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:08:57.834497 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:57.835908 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:08:58.097728 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:08:58.098376 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-49b84275-1762-4a7b-b825-39e467ad283f tempest-FloatingIPsAssociationTestJSON-1545682730 tempest-FloatingIPsAssociationTestJSON-1545682730-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:10.943722 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:09:10.960480 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:10.960914 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:11.156258 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:11.161471 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:11.161471 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:11.161471 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:11.177557 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Getting quotas for project 8d16030ff4084c619950a3f084802a50. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:09:11.181726 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Getting quotas for user b4f56775647d407d9666405d3ef2abea and project 8d16030ff4084c619950a3f084802a50. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:09:11.195081 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] [instance: 1b014804-71a0-4b76-8015-cd26e457e184] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:09:11.196546 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:11.197112 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:11.320442 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] [instance: 1b014804-71a0-4b76-8015-cd26e457e184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:09:11.321679 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:11.322083 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:11.670442 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:11.672407 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36d19948-3c42-48c3-9328-071b18a297b8 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:19.379630 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-04ba9c24-dc39-4636-8787-e503a05eec15 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:09:19.380860 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-04ba9c24-dc39-4636-8787-e503a05eec15 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:19.381429 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-04ba9c24-dc39-4636-8787-e503a05eec15 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:20.073338 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-04ba9c24-dc39-4636-8787-e503a05eec15 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Created allocations for migration 1d5f1cc0-5d3d-4ce5-83e9-98390125a8b8 on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:09:20.762185 chdv-809057-1 nova-conductor[101395]: DEBUG nova.scheduler.utils [None req-04ba9c24-dc39-4636-8787-e503a05eec15 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] [instance: 6f130b21-01d3-4599-8edf-0d4755e3c98b] Instance allocations successfully created on destination node 7790447f-ae2c-4619-9754-640c71ce9599: {'allocations': {'7790447f-ae2c-4619-9754-640c71ce9599': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=101395) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:842}} Sep 15 03:09:20.762785 chdv-809057-1 nova-conductor[101395]: DEBUG nova.objects.instance [None req-04ba9c24-dc39-4636-8787-e503a05eec15 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lazy-loading 'resources' on Instance uuid 6f130b21-01d3-4599-8edf-0d4755e3c98b {{(pid=101395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:09:20.768282 chdv-809057-1 nova-conductor[101395]: DEBUG nova.objects.instance [None req-04ba9c24-dc39-4636-8787-e503a05eec15 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6f130b21-01d3-4599-8edf-0d4755e3c98b {{(pid=101395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:09:21.429766 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.live_migrate [None req-04ba9c24-dc39-4636-8787-e503a05eec15 tempest-LiveMigrationTest-1595923022 tempest-LiveMigrationTest-1595923022-project-admin] [instance: 6f130b21-01d3-4599-8edf-0d4755e3c98b] Start binding ports on destination host: chh1-809057-1 {{(pid=101395) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:386}} Sep 15 03:09:24.537683 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:09:24.591083 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:24.591083 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:24.723203 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:24.730899 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:24.738715 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:24.739138 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:24.775486 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:09:24.786112 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for user 7758dc3f6f304d72a379df79f1e7e403 and project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:09:24.809726 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 3eef8e64-fc36-47e9-96ef-f873a746539d] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:09:24.811056 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:24.816125 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:24.883153 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 3eef8e64-fc36-47e9-96ef-f873a746539d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:09:24.885485 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:24.886081 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:25.121981 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:25.123023 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-594f8adc-34be-4dc4-826c-21a8dd15f185 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:26.572172 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:09:26.643185 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:26.648492 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:26.923976 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:26.924416 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:26.925232 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:26.925650 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:26.954720 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Getting quotas for project 33cc42d884b14df79d83d16cfc5fb9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:09:26.959370 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Getting quotas for user 55fa0c4942474637a522fd9d1555b101 and project 33cc42d884b14df79d83d16cfc5fb9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:09:26.992721 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] [instance: e7cabc3a-2054-4e7d-bf80-d5320b41091f] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:09:26.996173 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:26.996804 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:27.066202 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] [instance: e7cabc3a-2054-4e7d-bf80-d5320b41091f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:09:27.068162 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:27.068753 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:27.330695 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:27.331342 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fcd0ec2e-e16e-4d98-8c4c-7fc4f146f7cb tempest-FloatingIPsAssociationNegativeTestJSON-1375208475 tempest-FloatingIPsAssociationNegativeTestJSON-1375208475-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:32.817407 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:09:32.851266 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:32.851729 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:32.977502 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:32.977917 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:32.978956 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:32.979519 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:33.002472 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:09:33.006139 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for user 7758dc3f6f304d72a379df79f1e7e403 and project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:09:33.019990 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 4475b3b1-970b-4a93-aa05-1dc352743997] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:09:33.019990 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:33.019990 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:33.071763 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 4475b3b1-970b-4a93-aa05-1dc352743997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:09:33.073993 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:33.074474 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:33.275974 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:33.276281 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6521db89-066b-4867-84f2-b07fd398530d tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:46.316692 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:09:46.344656 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:46.345180 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:46.528845 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:46.529255 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:46.529981 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:46.530381 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:46.545710 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Getting quotas for project 73e24f0984214725af11c13c6c29d80c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:09:46.549304 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Getting quotas for user 91b36fa31842406586fa8a2cd096ea71 and project 73e24f0984214725af11c13c6c29d80c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:09:46.560157 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] [instance: 595bd051-e815-456d-8bf5-10b969e24640] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:09:46.561106 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:46.561503 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:46.665922 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] [instance: 595bd051-e815-456d-8bf5-10b969e24640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:09:46.666857 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:46.667258 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:09:46.958716 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:09:46.959283 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da658fbd-1e18-4b18-8b37-2765aa6b6e9f tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:04.493501 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:10:04.518687 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:04.519511 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:04.662764 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:04.665334 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:04.666286 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:04.669874 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:04.707537 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Getting quotas for project 8d16030ff4084c619950a3f084802a50. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:10:04.713149 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Getting quotas for user b4f56775647d407d9666405d3ef2abea and project 8d16030ff4084c619950a3f084802a50. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:10:04.725805 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] [instance: f1ed2050-2c80-46cb-be04-fc7866ee9da0] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:10:04.727163 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:04.727917 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:04.807880 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] [instance: f1ed2050-2c80-46cb-be04-fc7866ee9da0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:10:04.809444 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:04.810074 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:05.072572 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:05.073040 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e477f4f6-a034-4af3-a41c-fc68e28a2847 tempest-SecurityGroupsTestJSON-590318715 tempest-SecurityGroupsTestJSON-590318715-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:05.420085 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:10:05.478471 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:05.486161 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:05.641110 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:05.651808 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:05.652781 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:05.653268 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:05.705462 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:10:05.719432 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for user 7758dc3f6f304d72a379df79f1e7e403 and project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:10:05.755858 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: bd000b5c-71b7-4495-981d-539e7be54be0] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:10:05.762204 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:05.762204 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:05.856021 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: bd000b5c-71b7-4495-981d-539e7be54be0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:10:05.859984 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:05.861012 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:06.216443 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:06.218396 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-74a13e1d-30b0-43fd-9c37-131c18610f4e tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:11.503817 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6673956d-5452-48cd-9fe5-e791a6485cf2 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method rebuild_instance {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:10:11.509368 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6673956d-5452-48cd-9fe5-e791a6485cf2 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:11.509368 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6673956d-5452-48cd-9fe5-e791a6485cf2 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:11.618377 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6673956d-5452-48cd-9fe5-e791a6485cf2 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] [instance: 595bd051-e815-456d-8bf5-10b969e24640] No migration record for the rebuild/evacuate request. {{(pid=101396) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1127}} Sep 15 03:10:17.996676 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:10:19.015942 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55754. Sep 15 03:10:23.538896 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:10:23.560036 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:23.560574 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:23.765719 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:23.765719 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:23.765719 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:23.765719 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:23.786881 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Getting quotas for project e16b84160a30471b9a37a0dac2085ece. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:10:23.799170 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Getting quotas for user 89cc5c04a31244968006128fdd3778d3 and project e16b84160a30471b9a37a0dac2085ece. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:10:23.809814 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] [instance: 1e504aa1-577f-4cb6-af5f-8b69eb667504] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:10:23.811143 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:23.811790 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:23.876015 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] [instance: 1e504aa1-577f-4cb6-af5f-8b69eb667504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:10:23.878639 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:23.879358 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:24.165563 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:24.165984 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ce18ea6e-abf7-4e95-abbe-596bc6c2b41e tempest-ImagesNegativeTestJSON-1368401 tempest-ImagesNegativeTestJSON-1368401-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:27.739413 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:10:27.760524 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:27.760829 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:27.952028 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:27.952526 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:27.953748 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:27.954160 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:27.989822 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Getting quotas for project f1e17f525bc0423e9fdca982165d295f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:10:28.004245 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Getting quotas for user 34e1739ad3a9402bbff40c2e7de19a4d and project f1e17f525bc0423e9fdca982165d295f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:10:28.017401 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] [instance: a980a330-363e-4548-9ba3-0281fff95577] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:10:28.018352 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:28.018771 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:28.094614 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] [instance: a980a330-363e-4548-9ba3-0281fff95577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:10:28.097484 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:28.098081 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:28.379516 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:28.379931 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-0bfac516-4ac6-4e82-aa2b-0c4b4acad5f4 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:43.269912 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:10:43.298284 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:43.298687 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:43.486385 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:43.486837 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:43.487594 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:43.487984 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:43.506768 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Getting quotas for project 73e24f0984214725af11c13c6c29d80c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:10:43.514412 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Getting quotas for user 91b36fa31842406586fa8a2cd096ea71 and project 73e24f0984214725af11c13c6c29d80c. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:10:43.525090 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] [instance: af0e52e6-37fd-4923-b5dc-2edabe325e3a] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:10:43.526088 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:43.526512 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:43.601256 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] [instance: af0e52e6-37fd-4923-b5dc-2edabe325e3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:10:43.603405 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:43.604042 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:10:43.878154 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:10:43.879059 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8a306097-e571-4b96-9fad-59a3b7fced06 tempest-ServerDiskConfigTestJSON-684436755 tempest-ServerDiskConfigTestJSON-684436755-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:10.828130 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:11:10.847232 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:10.847681 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:11.087364 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:11.087943 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:11.088770 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:11.089256 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:11.106364 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Getting quotas for project d2e5c72697f74f3ca342c04a9cdaa445. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:11:11.110947 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Getting quotas for user 6df4b165e50c42feb7544b62aa9018be and project d2e5c72697f74f3ca342c04a9cdaa445. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:11:11.128439 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] [instance: 03ff887b-39a3-4f41-9be4-29afde30bdae] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:11:11.129562 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:11.130064 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:11.216719 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] [instance: 03ff887b-39a3-4f41-9be4-29afde30bdae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:11:11.218323 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:11.218824 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:11.532260 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:11.532666 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54043d32-cc22-4f63-8829-d680d797b035 tempest-InstanceActionsTestJSON-1672735781 tempest-InstanceActionsTestJSON-1672735781-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:11.857987 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:11:11.882305 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:11.885373 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:12.077528 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:12.080748 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:12.081599 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:12.083751 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:12.125882 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Getting quotas for project cbfe49a14e4f4fbb8bf3cc50c4e4c7fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:11:12.134200 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Getting quotas for user ac40a118dd564009a09f921d781db6a8 and project cbfe49a14e4f4fbb8bf3cc50c4e4c7fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:11:12.149106 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] [instance: e6fa0ca8-a95a-4f99-b147-101132efd93c] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:11:12.150010 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:12.150413 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:12.239780 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] [instance: e6fa0ca8-a95a-4f99-b147-101132efd93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:11:12.241145 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:12.241682 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:12.566378 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:12.566800 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d1d3aaa7-3fce-4427-a731-398f487631e9 tempest-InstanceActionsV221TestJSON-1509240983 tempest-InstanceActionsV221TestJSON-1509240983-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:15.336194 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:11:15.394090 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:15.394523 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:15.536898 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:15.537873 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:15.538610 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:15.539024 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:15.555998 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Getting quotas for project f1e17f525bc0423e9fdca982165d295f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:11:15.561208 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Getting quotas for user 34e1739ad3a9402bbff40c2e7de19a4d and project f1e17f525bc0423e9fdca982165d295f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:11:15.579468 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] [instance: 346e4c52-dfc4-4a13-84ea-b0f374d8116e] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:11:15.581268 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:15.581873 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:15.650459 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] [instance: 346e4c52-dfc4-4a13-84ea-b0f374d8116e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:11:15.652110 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:15.653111 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:15.841121 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:15.841530 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9ad92376-f6eb-4bfc-889f-f8237c266c12 tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:24.522625 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:11:24.591320 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:24.591769 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:24.826730 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:24.827999 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:24.828731 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:24.829845 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:24.870629 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:11:24.879280 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for user 7758dc3f6f304d72a379df79f1e7e403 and project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:11:24.907631 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 44d39b2c-ffbf-4394-890e-e1362bf9abcf] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:11:24.909170 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:24.909603 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:24.964982 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 44d39b2c-ffbf-4394-890e-e1362bf9abcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:11:24.967360 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:24.967360 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:25.241930 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:25.242366 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e6129295-480c-46c5-9ec7-485892409dc9 tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:37.908990 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:11:38.932049 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57684. Sep 15 03:11:47.032970 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:11:47.055961 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:47.056327 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:47.387354 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:47.401994 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:47.404638 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:47.406791 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:47.451105 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Getting quotas for project 47fe14da8d8140d38ca990e42a12cd1e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:11:47.461116 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Getting quotas for user a4e988991ba743beb77d32aac69f56ea and project 47fe14da8d8140d38ca990e42a12cd1e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:11:47.477967 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] [instance: ba179e0b-0755-44de-8089-9899db29a64f] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:11:47.479153 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:47.480714 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:47.547551 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] [instance: ba179e0b-0755-44de-8089-9899db29a64f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:11:47.549079 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:47.549907 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:47.805131 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:47.806539 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f139faff-aac7-4904-bbeb-e4c0e24ed695 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:48.099579 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:11:48.126905 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:48.127321 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:48.454665 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:48.455068 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:48.456227 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:48.456842 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:48.479429 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Getting quotas for project 55b7baa499564c6bb7a2710a50bd527d. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:11:48.485895 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Getting quotas for user c5d474e002d94d76a8d464ad0b8eb921 and project 55b7baa499564c6bb7a2710a50bd527d. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:11:48.505930 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] [instance: 44d7944a-b19c-4aa6-a8b1-09498a7fff31] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:11:48.507335 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:48.508836 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:48.581749 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] [instance: 44d7944a-b19c-4aa6-a8b1-09498a7fff31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:11:48.585763 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:48.589773 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:48.902850 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:48.907275 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-cfbfb483-a811-41ec-b0c1-42c68f5c1c65 tempest-InstanceActionsNegativeTestJSON-1422771267 tempest-InstanceActionsNegativeTestJSON-1422771267-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:57.554648 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Took 1.26 seconds to select destinations for 3 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:11:57.574197 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:57.574601 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:57.758633 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:57.758937 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:57.870433 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:57.870840 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:57.974264 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:57.974844 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:57.975612 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:57.976013 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:57.995164 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Getting quotas for project d3bf507d88be4fce985734b77f5ad966. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:11:58.000080 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Getting quotas for user 11f6d8920d2d4530bf98800657fa68f2 and project d3bf507d88be4fce985734b77f5ad966. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:11:58.011421 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] [instance: 9fb2b263-eb61-4eae-b433-553d94968d74] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:11:58.012487 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:58.012959 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:58.123513 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] [instance: 9fb2b263-eb61-4eae-b433-553d94968d74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:11:58.125121 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:58.125528 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:58.371279 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:58.371816 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:58.385085 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] [instance: 8397c9c8-39d1-41fb-92f0-28f2d0989450] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:11:58.385085 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:58.385085 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:58.461959 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] [instance: 8397c9c8-39d1-41fb-92f0-28f2d0989450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:11:58.467587 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:58.467587 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:58.719634 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:58.720289 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:58.734956 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] [instance: e01e1b70-a92a-4dcb-a800-e8637a43f9c3] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:11:58.734956 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:58.735670 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:58.803839 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] [instance: e01e1b70-a92a-4dcb-a800-e8637a43f9c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:11:58.805292 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:58.805812 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:11:59.108310 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:11:59.108711 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-64b018a7-672a-4008-91b9-45b2d3970892 tempest-ListServersNegativeTestJSON-1688292424 tempest-ListServersNegativeTestJSON-1688292424-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:04.003251 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:12:04.049717 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:04.050392 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:04.315463 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:04.316282 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:04.318606 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:04.319297 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:04.338914 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Getting quotas for project 7904e413f9dd4ef5b7820200be38625b. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:12:04.345984 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Getting quotas for user 060b1fb5db0b4d84a965947de7337143 and project 7904e413f9dd4ef5b7820200be38625b. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:12:04.361957 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] [instance: 10cf1576-bbf1-440c-9d7d-7b09cec61f87] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:12:04.365722 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:04.366447 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:04.466936 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] [instance: 10cf1576-bbf1-440c-9d7d-7b09cec61f87] block_device_mapping [BlockDeviceMapping(attachment_id=0f3db421-6af9-4c45-a4bc-5f938717047f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='fe3b0733-b06b-46a9-8259-f5af31a31bfb',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=88155f77-9564-49bf-8452-261cfbdbd963,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ce5a432f-98f9-4537-94b8-3dde74ac85b4',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=f9979374-4dcb-45c6-afc8-b5310eb94b3e,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f3c1d63-40ea-480d-9553-9747f3fc1899',volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:12:04.468772 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:04.469316 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:04.569962 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:04.570800 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:04.718279 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:04.718507 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:04.974460 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:04.974872 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8fe25a2f-3577-4ff1-84c3-12ffdf33b5ed tempest-TaggedBootDevicesTest_v242-1095034071 tempest-TaggedBootDevicesTest_v242-1095034071-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:17.686551 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:12:17.814963 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:12:17.854063 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:17.854668 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:18.138882 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:18.139591 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:18.141409 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:18.142067 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:18.171313 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:12:18.180388 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Getting quotas for user 7758dc3f6f304d72a379df79f1e7e403 and project c4f1ea0e40f74832b583fb6c92330a4b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:12:18.197677 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 0c851452-8b11-415e-988d-e43442887e51] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:12:18.201136 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:18.201806 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:18.265440 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] [instance: 0c851452-8b11-415e-988d-e43442887e51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:12:18.267298 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:18.268496 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:18.625104 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:18.625104 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-54051df5-59b9-4633-bd42-fb364658e24f tempest-DeleteServersTestJSON-1005834631 tempest-DeleteServersTestJSON-1005834631-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:21.428057 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:12:21.498257 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:21.499149 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:21.791197 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:21.792229 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:21.795587 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:21.796779 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:21.850883 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Getting quotas for project 8ddbdcfbda7c41d28e714b4d5dcbb53b. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:12:21.857715 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Getting quotas for user e69030a02ed34a6289f2c10fba3a2c54 and project 8ddbdcfbda7c41d28e714b4d5dcbb53b. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:12:21.881799 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] [instance: 81dbbb31-5ff7-4e22-bfb4-0305fc8b96e9] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:12:21.885004 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:21.893976 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:22.008742 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] [instance: 81dbbb31-5ff7-4e22-bfb4-0305fc8b96e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:12:22.010254 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:22.010920 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:22.313237 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:22.313237 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-151a505c-69cd-45c7-bf03-734615c4038e tempest-ServersTestFqdnHostnames-571289292 tempest-ServersTestFqdnHostnames-571289292-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:41.581535 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:12:41.602227 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:41.602756 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:41.781570 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:41.782104 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:41.782940 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:41.783369 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:41.800780 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Getting quotas for project c0098cb42799497cb34dafcb7745471b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:12:41.805682 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Getting quotas for user 294c121d75404d31afffa5c0fb75c677 and project c0098cb42799497cb34dafcb7745471b. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:12:41.817259 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] [instance: 698757b9-60c5-4968-84ff-0f5e5517ee45] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:12:41.818435 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:41.818908 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:41.884769 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] [instance: 698757b9-60c5-4968-84ff-0f5e5517ee45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:12:41.886317 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:41.886476 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:42.177152 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:42.177831 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6707b8e2-5191-4fc6-bc12-f8742683d605 tempest-ServerAddressesNegativeTestJSON-579561576 tempest-ServerAddressesNegativeTestJSON-579561576-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:43.604966 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:12:43.675655 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:43.676438 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:43.987962 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:43.987962 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:43.988364 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:43.989040 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:44.022771 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Getting quotas for project f1e17f525bc0423e9fdca982165d295f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:12:44.033274 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Getting quotas for user 34e1739ad3a9402bbff40c2e7de19a4d and project f1e17f525bc0423e9fdca982165d295f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:12:44.047638 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] [instance: c4845929-05a8-4980-be33-428deec4c859] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:12:44.048977 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:44.050133 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:44.179953 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] [instance: c4845929-05a8-4980-be33-428deec4c859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:12:44.181694 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:44.182229 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:44.493597 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:44.498640 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d890cdc-4033-415a-aca3-2a461e78160c tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:53.464563 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:12:53.483481 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:53.483945 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:53.650980 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:53.651891 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:53.653144 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:53.653649 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:53.680502 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Getting quotas for project 47fe14da8d8140d38ca990e42a12cd1e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:12:53.687605 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Getting quotas for user a4e988991ba743beb77d32aac69f56ea and project 47fe14da8d8140d38ca990e42a12cd1e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:12:53.703267 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] [instance: f1401684-5f9c-4ae7-aa9a-5faee556483f] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:12:53.705919 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:53.706506 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:53.786095 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] [instance: f1401684-5f9c-4ae7-aa9a-5faee556483f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:12:53.787366 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:53.787832 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:54.056097 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:54.056772 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-88b2cdbf-3d69-4a6b-a406-3de97db82045 tempest-ServerRescueTestJSON-886621011 tempest-ServerRescueTestJSON-886621011-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:55.105644 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:12:55.126620 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:55.127582 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:55.328987 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:55.329491 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:55.332858 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:55.333409 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:55.360313 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:12:55.366050 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for user a39205d96c4745519319466265160428 and project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:12:55.377283 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 45ab1248-2fb9-4ba1-8e40-152583d99097] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:12:55.378398 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:55.378796 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:55.446484 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 45ab1248-2fb9-4ba1-8e40-152583d99097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:12:55.448868 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:55.450450 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:12:55.747584 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:12:55.751865 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b4e7b11f-0a56-40ff-8c3a-73975d310473 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:07.887342 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:13:07.917846 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:07.918521 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:08.213092 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:08.215048 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:08.216102 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:08.216723 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:08.241154 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Getting quotas for project 201fe991738f4a5687c59a853f98b9fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:13:08.249974 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Getting quotas for user 37381aeda46143538d75590182a5e80c and project 201fe991738f4a5687c59a853f98b9fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:13:08.279870 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] [instance: b2d3d4d1-4b4e-4e8e-b573-4d422c693945] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:13:08.280903 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:08.281553 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:08.369611 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] [instance: b2d3d4d1-4b4e-4e8e-b573-4d422c693945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:13:08.371074 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:08.371567 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:08.689986 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:08.689986 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb6305d2-f7d7-456b-b909-51d2bf91c881 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:12.202791 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:13:12.246158 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:12.248079 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:12.551727 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:12.554109 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:12.555046 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:12.555964 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:12.585953 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:13:12.591808 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for user 69050e57e7b748cca18f9aa96c397d22 and project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:13:12.611945 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: bd3c27ba-a3b2-4a0d-8041-0dd7bb5fe49b] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:13:12.613883 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:12.614392 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:12.688166 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: bd3c27ba-a3b2-4a0d-8041-0dd7bb5fe49b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:13:12.691524 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:12.692160 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:12.976565 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:12.977183 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ca3015da-169f-47df-8d9d-87d880abf439 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:18.949529 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:13:18.986606 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:18.987010 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:19.046650 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:13:19.148699 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:19.151518 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:19.159008 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:19.160300 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:19.203012 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:13:19.227923 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for user a39205d96c4745519319466265160428 and project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:13:19.253492 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 421a08e5-90ac-4fdc-80ee-8a80d51eaf7f] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:13:19.254746 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:19.256730 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:19.329086 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 421a08e5-90ac-4fdc-80ee-8a80d51eaf7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:13:19.331074 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:19.331964 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:19.535435 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:19.536579 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:19.564203 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [5fccc553-b51d-4cbe-bb24-b87eb559ba70] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 03:13:20.072903 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60128. Sep 15 03:13:20.592917 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [5fccc553-b51d-4cbe-bb24-b87eb559ba70] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60146. Sep 15 03:13:20.738476 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:20.739020 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-07da04a6-d959-4d87-ba99-d9ef7579628c tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.215742 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:13:24.261109 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.262591 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.425713 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:13:24.451669 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.452361 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.556546 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.557058 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.558581 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.558581 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.626743 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.631204 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.637530 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.638244 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.653402 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Getting quotas for project 577ccb78511d468eac7cb5260ab57a6d. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:13:24.670720 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Getting quotas for user 2fe71fea55c14d1fb641f23a110a8dab and project 577ccb78511d468eac7cb5260ab57a6d. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:13:24.688084 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:13:24.692513 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] [instance: 3737142a-d192-49fc-aaec-4495c008ab73] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:13:24.693671 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.694292 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.701660 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for user a39205d96c4745519319466265160428 and project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:13:24.729083 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: f854db91-67f4-4208-8577-cf387b3dcec7] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:13:24.740153 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.740775 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.779587 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] [instance: 3737142a-d192-49fc-aaec-4495c008ab73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:13:24.781136 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.781707 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:24.847844 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: f854db91-67f4-4208-8577-cf387b3dcec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:13:24.849747 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:24.850519 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:25.036422 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:25.037041 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e51bec74-8fb1-4d95-9733-e24859f491da tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:25.103780 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:25.104432 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5831619e-6a46-4d04-8b55-35fa1f2919ad tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:25.978382 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:13:26.015466 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:26.016196 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:26.137838 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:26.138544 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:26.139729 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:26.140298 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:26.160391 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Getting quotas for project 577ccb78511d468eac7cb5260ab57a6d. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:13:26.167694 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Getting quotas for user 2fe71fea55c14d1fb641f23a110a8dab and project 577ccb78511d468eac7cb5260ab57a6d. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:13:26.180879 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] [instance: 82b645a1-c91e-4ff8-a1b5-6fa6f2b49a46] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:13:26.182147 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:26.190760 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:26.269279 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] [instance: 82b645a1-c91e-4ff8-a1b5-6fa6f2b49a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:13:26.270898 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:26.271624 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:26.651403 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:26.651795 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5985c353-6b65-47f9-ac6d-08cf4f42d5ec tempest-ServerRescueNegativeTestJSON-1129379227 tempest-ServerRescueNegativeTestJSON-1129379227-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:35.055541 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-8eade742-5ab4-447c-a670-7f139b0d29c0 tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:13:35.056170 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-8eade742-5ab4-447c-a670-7f139b0d29c0 tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:35.056772 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-8eade742-5ab4-447c-a670-7f139b0d29c0 tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:35.624692 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-8eade742-5ab4-447c-a670-7f139b0d29c0 tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Created allocations for migration 9aa3d06d-425b-43bd-9ab7-62c8fe3483d4 on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:13:35.920332 chdv-809057-1 nova-conductor[101396]: DEBUG nova.scheduler.utils [None req-8eade742-5ab4-447c-a670-7f139b0d29c0 tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] [instance: b2d3d4d1-4b4e-4e8e-b573-4d422c693945] Instance allocations successfully created on destination node 7790447f-ae2c-4619-9754-640c71ce9599: {'allocations': {'7790447f-ae2c-4619-9754-640c71ce9599': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101396) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:842}} Sep 15 03:13:35.923539 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-8eade742-5ab4-447c-a670-7f139b0d29c0 tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lazy-loading 'resources' on Instance uuid b2d3d4d1-4b4e-4e8e-b573-4d422c693945 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:13:35.926137 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-8eade742-5ab4-447c-a670-7f139b0d29c0 tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lazy-loading 'pci_requests' on Instance uuid b2d3d4d1-4b4e-4e8e-b573-4d422c693945 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:13:36.548443 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.live_migrate [None req-8eade742-5ab4-447c-a670-7f139b0d29c0 tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] [instance: b2d3d4d1-4b4e-4e8e-b573-4d422c693945] Start binding ports on destination host: chh1-809057-1 {{(pid=101396) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:386}} Sep 15 03:13:37.948719 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:13:38.011692 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:38.012094 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:38.168776 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:38.169284 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:38.170095 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:38.170557 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:38.187227 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Getting quotas for project f1e17f525bc0423e9fdca982165d295f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:13:38.192991 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Getting quotas for user 34e1739ad3a9402bbff40c2e7de19a4d and project f1e17f525bc0423e9fdca982165d295f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:13:38.204181 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] [instance: ce5996df-356e-4211-bbd6-498d0520d9b1] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:13:38.205214 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:38.205687 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:38.315210 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] [instance: ce5996df-356e-4211-bbd6-498d0520d9b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:13:38.317469 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:38.317469 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:38.618735 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:38.619149 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-ef5df262-4589-4407-977f-41b34ec9ca5e tempest-ImagesTestJSON-2124220996 tempest-ImagesTestJSON-2124220996-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:49.494716 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:13:49.520441 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:49.520866 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:49.625359 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:49.625359 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:49.626556 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:49.626949 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:49.642486 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:13:49.647250 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for user a39205d96c4745519319466265160428 and project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:13:49.659092 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 819ac1b8-22c7-49d9-acfd-8e694bb8e670] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:13:49.660073 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:49.660482 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:49.747768 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 819ac1b8-22c7-49d9-acfd-8e694bb8e670] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:13:49.749010 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:49.749413 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:50.035641 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:50.036075 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e8ed3e95-bf3f-46c1-8f66-03b9fc2c11b9 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:53.833577 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:13:53.863043 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:53.863885 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:53.979748 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:53.980296 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:53.981035 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:53.981647 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:54.001217 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Getting quotas for project 201fe991738f4a5687c59a853f98b9fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:13:54.006136 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Getting quotas for user 37381aeda46143538d75590182a5e80c and project 201fe991738f4a5687c59a853f98b9fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:13:54.019291 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] [instance: e80152d4-e7a7-4b56-9378-f622d2f37819] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:13:54.020602 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:54.021407 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:54.104380 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] [instance: e80152d4-e7a7-4b56-9378-f622d2f37819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:13:54.105933 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:54.106574 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:13:54.369279 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:13:54.369833 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a01d354f-f152-47b7-aba3-bc6ff1e8eddb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:12.272981 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:14:12.293091 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:12.294784 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:12.520458 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:12.521009 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:12.521758 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:12.522155 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:12.541908 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:14:12.546387 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for user a39205d96c4745519319466265160428 and project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:14:12.557849 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 12e5c1f2-641f-42ae-942c-5bc19bf7b28b] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:14:12.558778 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:12.559265 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:12.619987 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 12e5c1f2-641f-42ae-942c-5bc19bf7b28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:14:12.625600 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:12.626086 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:12.794900 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-1ee5b11c-26f1-418b-b8bd-def40af42d2d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:14:12.795397 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-1ee5b11c-26f1-418b-b8bd-def40af42d2d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:12.795857 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-1ee5b11c-26f1-418b-b8bd-def40af42d2d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:12.950279 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:12.953303 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55326653-0f40-4a63-973e-8e3f3f8b69eb tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:12.958498 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:14:12.999329 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:12.999960 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:13.243403 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:13.246868 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:13.246868 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:13.246868 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:13.300782 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Getting quotas for project 2227ec2b0ef746faacc604b5cd5b45af. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:14:13.311007 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Getting quotas for user 060077a2037c4695a1b8b96fce341584 and project 2227ec2b0ef746faacc604b5cd5b45af. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:14:13.336312 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] [instance: 9c76c551-c334-4d72-bb15-a05ac90568ed] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:14:13.337795 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:13.338298 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:13.555726 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] [instance: 9c76c551-c334-4d72-bb15-a05ac90568ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:14:13.556906 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:13.557347 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:13.703547 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-1ee5b11c-26f1-418b-b8bd-def40af42d2d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Created allocations for migration af38f858-04a2-42d3-b220-4793c11b2d61 on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:14:13.863692 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:13.871491 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-67f8a96b-504d-488b-9ee1-a7adbdaf351b tempest-ImagesOneServerTestJSON-363508498 tempest-ImagesOneServerTestJSON-363508498-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:14.083721 chdv-809057-1 nova-conductor[101396]: DEBUG nova.scheduler.utils [None req-1ee5b11c-26f1-418b-b8bd-def40af42d2d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] [instance: e80152d4-e7a7-4b56-9378-f622d2f37819] Instance allocations successfully created on destination node 7790447f-ae2c-4619-9754-640c71ce9599: {'allocations': {'7790447f-ae2c-4619-9754-640c71ce9599': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101396) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:842}} Sep 15 03:14:14.083721 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-1ee5b11c-26f1-418b-b8bd-def40af42d2d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lazy-loading 'resources' on Instance uuid e80152d4-e7a7-4b56-9378-f622d2f37819 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:14:14.083721 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-1ee5b11c-26f1-418b-b8bd-def40af42d2d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lazy-loading 'pci_requests' on Instance uuid e80152d4-e7a7-4b56-9378-f622d2f37819 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:14:14.929353 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.live_migrate [None req-1ee5b11c-26f1-418b-b8bd-def40af42d2d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] [instance: e80152d4-e7a7-4b56-9378-f622d2f37819] Start binding ports on destination host: chh1-809057-1 {{(pid=101396) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:386}} Sep 15 03:14:19.940260 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:14:19.960463 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:19.960873 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:20.156139 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:20.156548 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:20.157842 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:20.158327 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:20.174272 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Getting quotas for project 7287aa94c7b84c8b94cca10f481f2b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:14:20.179332 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Getting quotas for user 5970f254ec5740ff82ca1b9fe5ddef6a and project 7287aa94c7b84c8b94cca10f481f2b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:14:20.190186 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] [instance: bc25f9a8-1171-4ab7-bc7f-18c6ea98e718] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:14:20.193247 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:20.193247 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:20.289335 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] [instance: bc25f9a8-1171-4ab7-bc7f-18c6ea98e718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:14:20.290627 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:20.291026 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:20.622665 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:20.623070 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-b5b6143a-b390-4ecb-9f31-6c428fc01c52 tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:28.907105 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e07ad7bd-90e9-4f68-8804-efb17faf39bf tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method rebuild_instance {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:14:28.907699 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e07ad7bd-90e9-4f68-8804-efb17faf39bf tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:28.908109 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e07ad7bd-90e9-4f68-8804-efb17faf39bf tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:29.017217 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e07ad7bd-90e9-4f68-8804-efb17faf39bf tempest-ServerShowV257Test-516005271 tempest-ServerShowV257Test-516005271-project] [instance: bc25f9a8-1171-4ab7-bc7f-18c6ea98e718] No migration record for the rebuild/evacuate request. {{(pid=101396) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1127}} Sep 15 03:14:30.808579 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:14:30.827737 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:30.828199 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:30.928894 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:30.929339 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:30.930070 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:30.930462 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:30.944777 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:14:30.949185 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for user a39205d96c4745519319466265160428 and project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:14:30.959580 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 45d63172-f4c3-44f9-be60-f89f1d3f6efd] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:14:30.960503 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:30.960904 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:31.032742 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 45d63172-f4c3-44f9-be60-f89f1d3f6efd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:14:31.034091 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:31.034697 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:31.290813 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:31.291225 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-8d1b2247-b1a3-438a-8438-ae299341166a tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:32.308800 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:14:32.326464 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:32.326872 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:32.443770 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:32.444189 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:32.445022 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:32.445423 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:32.461464 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Getting quotas for project 201fe991738f4a5687c59a853f98b9fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:14:32.466143 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Getting quotas for user 37381aeda46143538d75590182a5e80c and project 201fe991738f4a5687c59a853f98b9fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:14:32.477249 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] [instance: f5ce2876-5ffc-4c6c-8612-4e31824288c1] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:14:32.478256 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:32.478664 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:32.555858 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] [instance: f5ce2876-5ffc-4c6c-8612-4e31824288c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:14:32.557315 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:32.557725 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:32.765298 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:14:32.766017 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-55f37cd8-a122-4c37-9afc-3988ce6a37cb tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:14:38.933202 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:14:39.959303 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33620. Sep 15 03:15:00.791332 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:15:00.830746 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:00.831352 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:00.978267 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:00.978671 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:00.979421 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:00.979832 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:00.995142 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:15:01.000454 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for user a39205d96c4745519319466265160428 and project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:15:01.011696 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 91640eec-f92e-487d-959e-0a436817e8c7] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:15:01.012729 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:01.013176 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:01.127988 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 91640eec-f92e-487d-959e-0a436817e8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:15:01.129266 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:01.129668 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:01.415302 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:01.415758 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-1218dfb4-d06e-48d0-a5de-a7b202e2d663 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:06.062521 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-745c90d4-b276-4e0e-bf74-2c900d4e1e6d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:15:06.063127 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-745c90d4-b276-4e0e-bf74-2c900d4e1e6d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:06.063447 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-745c90d4-b276-4e0e-bf74-2c900d4e1e6d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:06.930306 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-745c90d4-b276-4e0e-bf74-2c900d4e1e6d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Created allocations for migration b28baaca-c782-4de4-9251-0415a14f3e88 on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:15:07.370489 chdv-809057-1 nova-conductor[101396]: DEBUG nova.scheduler.utils [None req-745c90d4-b276-4e0e-bf74-2c900d4e1e6d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] [instance: f5ce2876-5ffc-4c6c-8612-4e31824288c1] Instance allocations successfully created on destination node 7790447f-ae2c-4619-9754-640c71ce9599: {'allocations': {'7790447f-ae2c-4619-9754-640c71ce9599': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101396) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:842}} Sep 15 03:15:07.370489 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-745c90d4-b276-4e0e-bf74-2c900d4e1e6d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lazy-loading 'resources' on Instance uuid f5ce2876-5ffc-4c6c-8612-4e31824288c1 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:15:07.376385 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-745c90d4-b276-4e0e-bf74-2c900d4e1e6d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lazy-loading 'pci_requests' on Instance uuid f5ce2876-5ffc-4c6c-8612-4e31824288c1 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:15:08.150817 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.live_migrate [None req-745c90d4-b276-4e0e-bf74-2c900d4e1e6d tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] [instance: f5ce2876-5ffc-4c6c-8612-4e31824288c1] Start binding ports on destination host: chh1-809057-1 {{(pid=101396) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:386}} Sep 15 03:15:24.288730 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:15:24.308236 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:24.308551 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:24.449937 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:24.450340 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:24.451254 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:24.451685 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:24.467008 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:15:24.472247 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Getting quotas for user a39205d96c4745519319466265160428 and project d23c6da0766f4292bf8c2c10cfc4a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:15:24.482669 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 3d198526-a763-49eb-bae2-cbccda1a7d27] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:15:24.483623 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:24.484062 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:24.670474 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] [instance: 3d198526-a763-49eb-bae2-cbccda1a7d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:15:24.674882 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:24.674882 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:25.062641 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:25.063622 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-443a60f9-2674-4bfb-b43e-80ecdbc53279 tempest-ServersTestJSON-1125616784 tempest-ServersTestJSON-1125616784-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:27.155320 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:15:27.177224 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:27.177634 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:27.461237 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:27.461736 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:27.462581 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:27.462980 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:27.479702 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Getting quotas for project c26a0c4b021346d792899e1a16f59741. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:15:27.485299 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Getting quotas for user 32311b6d31ee489cba2654f4272c6711 and project c26a0c4b021346d792899e1a16f59741. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:15:27.496440 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] [instance: cad59b8a-461a-4ecb-8ff9-8a1b38e671aa] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:15:27.497826 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:27.498884 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:27.674424 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] [instance: cad59b8a-461a-4ecb-8ff9-8a1b38e671aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:15:27.674424 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:27.674424 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:27.940358 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:15:27.940934 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7950fbc3-3547-48d2-bef3-53878194e165 tempest-ServersNegativeTestMultiTenantJSON-1110458565 tempest-ServersNegativeTestMultiTenantJSON-1110458565-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:15:37.736203 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:16:03.025914 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:16:03.050777 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:03.056821 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:03.247496 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:03.247931 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:03.249872 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:03.250360 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:03.270374 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Getting quotas for project 8a22d0a66b914eacbb3dde2d93c27128. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:16:03.285939 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Getting quotas for user bc4203569cb04b219ef8b0ec94707b8e and project 8a22d0a66b914eacbb3dde2d93c27128. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:16:03.307336 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] [instance: 1225c28e-12dc-4711-8a16-d3f5887f1649] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:16:03.308345 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:03.308742 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:03.406613 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] [instance: 1225c28e-12dc-4711-8a16-d3f5887f1649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:16:03.407927 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:03.408670 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:03.904110 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:03.904533 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d412d799-a52f-429d-bc07-adfcca347ba7 tempest-ServersTestManualDisk-359170786 tempest-ServersTestManualDisk-359170786-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:24.212700 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:16:24.244047 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:24.245714 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:24.425683 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:24.427932 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:24.430763 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:24.431499 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:24.472453 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Getting quotas for project 201fe991738f4a5687c59a853f98b9fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:16:24.479068 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Getting quotas for user 37381aeda46143538d75590182a5e80c and project 201fe991738f4a5687c59a853f98b9fb. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:16:24.496405 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] [instance: 42c409f4-ebca-43f7-bc5a-f0cb36b97be4] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:16:24.498597 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:24.499115 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:24.553225 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] [instance: 42c409f4-ebca-43f7-bc5a-f0cb36b97be4] block_device_mapping [BlockDeviceMapping(attachment_id=ea7b179e-011d-4d0c-ac9e-42ab05847f00,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb04747a-1b38-4185-84c6-99e70f9e68ce',volume_size=1,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:16:24.554887 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:24.555616 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:24.858729 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:24.859292 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-3e1cd6db-5ec8-4ea4-95ba-6b96168a6e62 tempest-LiveAutoBlockMigrationV225Test-889433435 tempest-LiveAutoBlockMigrationV225Test-889433435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:30.845477 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:16:30.911642 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:30.915942 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:31.272392 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:31.282097 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:31.282097 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:31.282097 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:31.308496 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Getting quotas for project 48706c73fc1548a492d405ea1da6f288. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:16:31.315444 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Getting quotas for user 8e4884744f594f8bbb8c290a107db6b8 and project 48706c73fc1548a492d405ea1da6f288. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:16:31.328635 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] [instance: 7ba20f55-0257-433e-86ac-b78e87589869] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:16:31.329895 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:31.330547 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:31.433572 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] [instance: 7ba20f55-0257-433e-86ac-b78e87589869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:16:31.435836 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:31.441387 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:31.825425 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:31.827565 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e41081f9-77f7-4056-8437-2455e58289dc tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:33.527650 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:16:33.584220 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:33.584971 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:33.854823 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:33.855245 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:33.856069 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:33.856494 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:33.877745 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Getting quotas for project 292206066242490ea4203c5271591b65. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:16:33.884005 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Getting quotas for user bcc121d78e6645d59b0fb856dec9e102 and project 292206066242490ea4203c5271591b65. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:16:33.907022 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] [instance: e7169a0b-352c-40a7-8a7b-60f01f77ec8b] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:16:33.907714 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:33.908301 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:34.004276 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] [instance: e7169a0b-352c-40a7-8a7b-60f01f77ec8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:16:34.010042 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:34.010042 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:34.617352 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:34.618016 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-42a1cb5c-0b1c-4a89-bed7-dd72ca323d3f tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:47.109472 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7db71442-4267-4cee-9ee2-14b7da3c5fcb tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method rebuild_instance {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:16:47.110242 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7db71442-4267-4cee-9ee2-14b7da3c5fcb tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:47.111200 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7db71442-4267-4cee-9ee2-14b7da3c5fcb tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:47.435178 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7db71442-4267-4cee-9ee2-14b7da3c5fcb tempest-ServerShowV254Test-1295292187 tempest-ServerShowV254Test-1295292187-project] [instance: 7ba20f55-0257-433e-86ac-b78e87589869] No migration record for the rebuild/evacuate request. {{(pid=101395) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1127}} Sep 15 03:16:49.771164 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-2de289bc-77da-494e-ba65-b61939c49c3e tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:16:49.771772 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2de289bc-77da-494e-ba65-b61939c49c3e tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:16:49.772072 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2de289bc-77da-494e-ba65-b61939c49c3e tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:16:50.519766 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-2de289bc-77da-494e-ba65-b61939c49c3e tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Created allocations for migration 43a4a490-8c50-4916-af7b-2d6c7b303708 on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:16:50.790972 chdv-809057-1 nova-conductor[101396]: DEBUG nova.scheduler.utils [None req-2de289bc-77da-494e-ba65-b61939c49c3e tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] [instance: 42c409f4-ebca-43f7-bc5a-f0cb36b97be4] Instance allocations successfully created on destination node 7790447f-ae2c-4619-9754-640c71ce9599: {'allocations': {'7790447f-ae2c-4619-9754-640c71ce9599': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=101396) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:842}} Sep 15 03:16:50.792338 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-2de289bc-77da-494e-ba65-b61939c49c3e tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lazy-loading 'resources' on Instance uuid 42c409f4-ebca-43f7-bc5a-f0cb36b97be4 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:16:50.800567 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-2de289bc-77da-494e-ba65-b61939c49c3e tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] Lazy-loading 'pci_requests' on Instance uuid 42c409f4-ebca-43f7-bc5a-f0cb36b97be4 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:16:51.693078 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.live_migrate [None req-2de289bc-77da-494e-ba65-b61939c49c3e tempest-LiveAutoBlockMigrationV225Test-1143633383 tempest-LiveAutoBlockMigrationV225Test-1143633383-project-admin] [instance: 42c409f4-ebca-43f7-bc5a-f0cb36b97be4] Start binding ports on destination host: chh1-809057-1 {{(pid=101396) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:386}} Sep 15 03:17:08.170933 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Took 1.63 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:17:08.206335 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:17:08.210443 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:17:08.479915 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:17:08.481458 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:17:08.483747 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:17:08.485253 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:17:08.510425 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Getting quotas for project f27b169efec243ea88d1ab16bc4a4221. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:17:08.516598 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Getting quotas for user c9a693f629e54b43b3504976901a9004 and project f27b169efec243ea88d1ab16bc4a4221. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:17:08.543223 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] [instance: 1221414a-7f82-4a1c-81e5-c1ef2cffe7bf] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:17:08.544389 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:17:08.547012 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:17:08.666344 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] [instance: 1221414a-7f82-4a1c-81e5-c1ef2cffe7bf] block_device_mapping [BlockDeviceMapping(attachment_id=16dbf915-9b06-497b-8daf-56e9dd164acb,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='df1367f0-2aa3-4815-9a1b-82b3e9a15ee0',volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:17:08.668577 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:17:08.669113 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:17:08.890662 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:17:08.891104 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-eedfe8aa-cf36-4c10-8a5c-ed2c1518dfd1 tempest-ServersTestBootFromVolume-1247510101 tempest-ServersTestBootFromVolume-1247510101-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:17:39.960969 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:17:40.982172 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38636. Sep 15 03:18:00.292549 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:18:00.340180 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:00.340673 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:00.545555 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:00.546108 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:00.546944 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:00.547456 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:00.568310 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Getting quotas for project ca924462246d42d2a94143a740e75011. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:18:00.571948 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Getting quotas for user aaf1be8da6374509a1e7fe8891c9c4ea and project ca924462246d42d2a94143a740e75011. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:18:00.584228 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: 2993aef8-07e2-40e2-8682-1de767ff809d] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:18:00.585524 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:00.586114 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:00.659261 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: 2993aef8-07e2-40e2-8682-1de767ff809d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:18:00.660560 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:00.661277 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:00.998810 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:00.999537 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-21f75aa4-a3fa-4f79-8615-5bad50ce7a8c tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:01.770392 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:18:01.802248 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:01.802673 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:01.927746 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:01.928211 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:01.929132 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:01.929547 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:01.945386 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:18:01.951489 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for user 69050e57e7b748cca18f9aa96c397d22 and project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:18:01.965577 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: a06cd4e2-7241-49f5-a06b-31dd1111ecc8] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:18:01.966402 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:01.968626 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:02.065215 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: a06cd4e2-7241-49f5-a06b-31dd1111ecc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:18:02.066536 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:02.066945 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:02.423481 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:02.423481 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-12150731-bf4a-4aa3-b27c-270db7cf7dc2 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:20.897885 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-2375c10a-fc76-411c-a166-fe12e4da8051 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:18:20.897885 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2375c10a-fc76-411c-a166-fe12e4da8051 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:20.898337 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2375c10a-fc76-411c-a166-fe12e4da8051 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:21.245691 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-2375c10a-fc76-411c-a166-fe12e4da8051 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] [instance: 2993aef8-07e2-40e2-8682-1de767ff809d] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101396) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 03:18:22.171363 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-2375c10a-fc76-411c-a166-fe12e4da8051 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] Created allocations for migration ae7b68d9-db9e-496e-b4a6-a07bf501ca13 on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:18:22.634862 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-2375c10a-fc76-411c-a166-fe12e4da8051 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] [instance: 2993aef8-07e2-40e2-8682-1de767ff809d] Calling prep_resize with selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101396) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 03:18:51.422995 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:18:51.475115 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:51.475764 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:51.692217 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:51.692618 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:51.693402 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:51.693899 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:51.712659 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:18:51.717060 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for user 69050e57e7b748cca18f9aa96c397d22 and project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:18:51.732778 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: a4999437-c0b4-45a1-a028-82cdd764e6c3] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:18:51.733842 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:51.734254 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:51.867013 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: a4999437-c0b4-45a1-a028-82cdd764e6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:18:51.868329 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:51.869014 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:18:52.135205 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:18:52.135744 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-818a942e-6ade-4ab3-9eb3-f9de45f0d593 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:00.952618 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:19:00.971466 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:00.972009 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:01.203334 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:01.203840 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:01.204650 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:01.205109 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:01.223872 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Getting quotas for project ca924462246d42d2a94143a740e75011. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:19:01.229268 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Getting quotas for user aaf1be8da6374509a1e7fe8891c9c4ea and project ca924462246d42d2a94143a740e75011. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:19:01.240576 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: f9c10445-ba03-4c28-be6f-f013a86b1a72] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:19:01.242430 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:01.242700 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:01.337536 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: f9c10445-ba03-4c28-be6f-f013a86b1a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:19:01.340001 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:01.340672 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:01.662833 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:01.663354 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-89350ff9-27b3-4f51-a3f8-1b5d5c0f2181 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:15.357366 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-77e44c99-7e6e-4ddd-9356-c56bac1672b6 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:19:15.357893 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-77e44c99-7e6e-4ddd-9356-c56bac1672b6 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:15.358239 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-77e44c99-7e6e-4ddd-9356-c56bac1672b6 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:16.002790 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-77e44c99-7e6e-4ddd-9356-c56bac1672b6 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: f9c10445-ba03-4c28-be6f-f013a86b1a72] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101395) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 03:19:16.724363 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-77e44c99-7e6e-4ddd-9356-c56bac1672b6 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Created allocations for migration f33e92fa-66f8-4dcd-a900-6f69cbfe7901 on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:19:17.143215 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-77e44c99-7e6e-4ddd-9356-c56bac1672b6 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: f9c10445-ba03-4c28-be6f-f013a86b1a72] Calling prep_resize with selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"4304e6a0-cb35-42bf-878b-c4da5dd28abd": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["4304e6a0-cb35-42bf-878b-c4da5dd28abd"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=4304e6a0-cb35-42bf-878b-c4da5dd28abd,limits=SchedulerLimits,nodename='chh2-809057-1',service_host='chh2-809057-1')] {{(pid=101395) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 03:19:20.078725 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:19:21.102477 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41188. Sep 15 03:19:57.703274 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:19:57.724144 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:57.724777 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:57.869826 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:57.870377 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:57.871171 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:57.871913 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:57.888691 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Getting quotas for project ca924462246d42d2a94143a740e75011. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:19:57.893712 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Getting quotas for user aaf1be8da6374509a1e7fe8891c9c4ea and project ca924462246d42d2a94143a740e75011. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:19:57.913320 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: 7738bf48-daa1-493c-9164-5bbd057220bb] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:19:57.914420 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:57.915411 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:58.018681 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: 7738bf48-daa1-493c-9164-5bbd057220bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:19:58.020081 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:58.020861 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:19:58.364460 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:19:58.364460 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43edaca6-0b84-4262-90b7-1ef7403d6a85 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:01.062711 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:20:21.375346 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e8f3120b-1fd4-4cb7-8914-ec816f570cd1 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:20:21.375993 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e8f3120b-1fd4-4cb7-8914-ec816f570cd1 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:21.376284 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e8f3120b-1fd4-4cb7-8914-ec816f570cd1 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:21.761690 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-e8f3120b-1fd4-4cb7-8914-ec816f570cd1 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: 7738bf48-daa1-493c-9164-5bbd057220bb] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101395) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 03:20:22.924021 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-e8f3120b-1fd4-4cb7-8914-ec816f570cd1 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Created allocations for migration 3b520deb-f0db-417d-ae77-c08747cdfab3 on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:20:23.430266 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-e8f3120b-1fd4-4cb7-8914-ec816f570cd1 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: 7738bf48-daa1-493c-9164-5bbd057220bb] Calling prep_resize with selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"7790447f-ae2c-4619-9754-640c71ce9599": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7790447f-ae2c-4619-9754-640c71ce9599"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=7790447f-ae2c-4619-9754-640c71ce9599,limits=SchedulerLimits,nodename='chh1-809057-1',service_host='chh1-809057-1')] {{(pid=101395) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 03:20:24.408826 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6b2471ed-97ba-4060-aeaa-2c9edf7d55bb tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method unshelve_instance {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:20:24.409986 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6b2471ed-97ba-4060-aeaa-2c9edf7d55bb tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:24.410624 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6b2471ed-97ba-4060-aeaa-2c9edf7d55bb tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:25.382130 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6b2471ed-97ba-4060-aeaa-2c9edf7d55bb tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] [instance: e7169a0b-352c-40a7-8a7b-60f01f77ec8b] Requesting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) during scheduling {{(pid=101396) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:927}} Sep 15 03:20:25.859047 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6b2471ed-97ba-4060-aeaa-2c9edf7d55bb tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:20:25.868277 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-6b2471ed-97ba-4060-aeaa-2c9edf7d55bb tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lazy-loading 'flavor' on Instance uuid e7169a0b-352c-40a7-8a7b-60f01f77ec8b {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:20:40.982093 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:20:42.023625 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42602. Sep 15 03:20:49.279781 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Took 0.94 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:20:49.317236 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:49.317892 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:49.577460 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:49.578592 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:49.581080 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:49.581856 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:49.631412 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Getting quotas for project c9707c12134947f9960718c0c7e4c10e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:20:49.643815 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Getting quotas for user 33e190930b4648d18f1f83f2dd896e9f and project c9707c12134947f9960718c0c7e4c10e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:20:49.667595 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] [instance: aea9c4a9-98a1-4114-b928-f71101f6df55] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:20:49.677446 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:49.677446 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:49.793831 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] [instance: aea9c4a9-98a1-4114-b928-f71101f6df55] block_device_mapping [BlockDeviceMapping(attachment_id=6d92e8dd-b48e-4145-9754-e5917f42e1b2,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d9a86aad-a476-4236-9cff-3a27051e1dd3',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=7ee4edc8-7396-4f65-bcd1-64a6b5c44aec,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='35a1177b-3ddb-485a-acf9-94a815ce2084',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=65933435-6805-460b-af0d-14a9368610c4,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b910a172-3232-40d0-bddf-b031289bd3db',volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:20:49.795955 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:49.796528 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:49.918783 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:49.919193 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:50.068295 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:50.071086 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:50.458602 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:50.459255 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7da2289b-a3f5-4398-80fd-8e35d604ad19 tempest-TaggedBootDevicesTest-825590548 tempest-TaggedBootDevicesTest-825590548-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:51.991215 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Took 0.96 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:20:52.046552 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:52.046805 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:52.268651 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:52.269056 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:52.269990 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:52.270902 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:52.289598 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Getting quotas for project 12efd131a6a04e27878e1ebfc95fb60e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:20:52.294723 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Getting quotas for user 12cff5c3e03c4954a0c84b64a594c158 and project 12efd131a6a04e27878e1ebfc95fb60e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:20:52.341199 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] [instance: af340bcd-fcad-4e0f-8197-533bce6574a3] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:20:52.342132 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:52.342733 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:52.444887 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] [instance: af340bcd-fcad-4e0f-8197-533bce6574a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:20:52.446468 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:52.447037 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:52.852286 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:52.852812 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-d0cbf628-9a15-4c0e-8a64-0377dc6d95f3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:55.395539 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:20:55.441365 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:55.441774 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:55.665196 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:55.665612 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:55.666344 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:55.666742 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:55.716260 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Getting quotas for project 12efd131a6a04e27878e1ebfc95fb60e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:20:55.721564 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Getting quotas for user 12cff5c3e03c4954a0c84b64a594c158 and project 12efd131a6a04e27878e1ebfc95fb60e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:20:55.737946 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] [instance: 1d5161d0-2cb2-4cf5-8d32-1372b055c7b9] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:20:55.753350 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:55.753350 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:55.911049 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] [instance: 1d5161d0-2cb2-4cf5-8d32-1372b055c7b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:20:55.912943 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:55.913788 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:56.183299 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:56.183722 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-23ab8e02-2fc4-4bb8-99e9-342cc6c3fc13 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:59.164193 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:20:59.217864 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:59.222855 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:59.450180 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:59.451581 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:59.456255 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:59.469837 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:59.534821 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Getting quotas for project 12efd131a6a04e27878e1ebfc95fb60e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:20:59.556191 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Getting quotas for user 12cff5c3e03c4954a0c84b64a594c158 and project 12efd131a6a04e27878e1ebfc95fb60e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:20:59.586624 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] [instance: cb5c5a6c-7c09-4ea7-9663-c3c7770354fe] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:20:59.588087 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:59.588694 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:20:59.742168 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] [instance: cb5c5a6c-7c09-4ea7-9663-c3c7770354fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:20:59.746874 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:20:59.748397 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:00.037025 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:00.037580 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-2130c072-abb0-4645-83a2-c82ee1ea80c3 tempest-ListServerFiltersTestJSON-344533109 tempest-ListServerFiltersTestJSON-344533109-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:25.419985 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:21:25.458848 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:25.459408 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:25.565103 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:25.565525 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:25.566262 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:25.566663 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:25.582438 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Getting quotas for project ca924462246d42d2a94143a740e75011. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:21:25.587092 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Getting quotas for user aaf1be8da6374509a1e7fe8891c9c4ea and project ca924462246d42d2a94143a740e75011. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:21:25.599248 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: 5063ae96-5ac4-44ba-b45c-9884fd460498] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:21:25.600138 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:25.600546 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:25.717770 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] [instance: 5063ae96-5ac4-44ba-b45c-9884fd460498] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:21:25.719726 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:25.720288 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:25.964939 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:25.965688 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-20e71dfb-3c7e-4c40-baa7-943b9eb4dda8 tempest-MigrationsAdminTest-32776384 tempest-MigrationsAdminTest-32776384-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:45.896209 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-c35f7db4-2034-40ca-ae70-08f9d3398fb1 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:21:45.898018 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-c35f7db4-2034-40ca-ae70-08f9d3398fb1 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:45.898618 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-c35f7db4-2034-40ca-ae70-08f9d3398fb1 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:46.268069 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-c35f7db4-2034-40ca-ae70-08f9d3398fb1 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] [instance: 5063ae96-5ac4-44ba-b45c-9884fd460498] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101396) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 03:21:46.907915 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-c35f7db4-2034-40ca-ae70-08f9d3398fb1 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] Created allocations for migration beb75414-5fde-45bb-bdb9-64be505c9fe2 on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:21:47.329468 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-c35f7db4-2034-40ca-ae70-08f9d3398fb1 tempest-MigrationsAdminTest-277960175 tempest-MigrationsAdminTest-277960175-project-admin] [instance: 5063ae96-5ac4-44ba-b45c-9884fd460498] Calling prep_resize with selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101396) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 03:21:51.931837 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:21:51.964625 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:51.964625 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:52.101863 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:52.104991 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:52.104991 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:52.104991 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:52.142820 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:21:52.147748 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for user 69050e57e7b748cca18f9aa96c397d22 and project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:21:52.162053 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: f2e27cc6-dd5b-45bb-9a2f-eb3f7c748ad8] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:21:52.163084 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:52.163570 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:52.242212 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: f2e27cc6-dd5b-45bb-9a2f-eb3f7c748ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:21:52.243503 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:52.243914 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:21:52.462505 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:21:52.463341 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7d13aa4f-3c5c-410d-b889-6a110f09f360 tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:17.764889 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:22:21.103991 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:22:22.142931 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44504. Sep 15 03:22:23.376681 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:22:23.413206 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:23.413617 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:23.576299 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:23.576879 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:23.577789 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:23.578670 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:23.628249 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:22:23.639912 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Getting quotas for user 69050e57e7b748cca18f9aa96c397d22 and project 4215296505d24f8795bf08c23075a8fa. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:22:23.665979 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: 3491cb32-d897-40ca-97c2-2f8e314e522b] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:22:23.667291 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:23.667964 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:23.795825 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] [instance: 3491cb32-d897-40ca-97c2-2f8e314e522b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:22:23.797498 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:23.798281 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:24.088974 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:24.089497 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b477eac1-83d1-4fb4-ab5c-c854d1362efc tempest-ServerActionsTestJSON-1483754907 tempest-ServerActionsTestJSON-1483754907-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:36.604985 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:22:36.645198 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:36.645624 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:36.954493 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:36.966794 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:36.967801 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:36.969415 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:37.016684 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Getting quotas for project 9b1002696d014a01953ff730c996dddb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:22:37.032362 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Getting quotas for user d146e02d742e490792f13fa647eb88e8 and project 9b1002696d014a01953ff730c996dddb. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:22:37.049871 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] [instance: cf752d53-2502-45a2-936e-4074c4e967e3] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:22:37.050955 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:37.051832 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:37.139175 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] [instance: cf752d53-2502-45a2-936e-4074c4e967e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:22:37.141389 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:37.142624 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:37.461734 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:37.462320 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-0643c457-a402-47ac-a2d0-e4c46c4a2e52 tempest-ServerPasswordTestJSON-953566794 tempest-ServerPasswordTestJSON-953566794-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:53.855567 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Took 1.37 seconds to select destinations for 2 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:22:53.934431 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:53.937926 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:54.453135 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:54.453550 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:54.670814 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:54.671891 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:54.672785 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:54.673278 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:54.695459 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Getting quotas for project 78ad622894b4459d9fef08c861a26384. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:22:54.703963 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Getting quotas for user 5df39fac0d684f998a70533abd7f3424 and project 78ad622894b4459d9fef08c861a26384. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:22:54.717633 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] [instance: 6d6416af-deb9-440e-a8e8-c1dd2dbcde27] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:22:54.725060 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:54.725848 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:54.920787 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] [instance: 6d6416af-deb9-440e-a8e8-c1dd2dbcde27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:22:54.923320 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:54.924091 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:55.200582 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:55.201784 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:55.221499 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] [instance: 5040d2e5-5337-4c7d-9984-073283f01f84] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:22:55.222934 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:55.223560 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:55.351053 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] [instance: 5040d2e5-5337-4c7d-9984-073283f01f84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:22:55.353396 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:55.353396 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:55.866954 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:55.866954 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fb1855ce-a95f-4e07-848b-598d581bfb44 tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:58.471724 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:22:58.540868 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:58.541278 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:58.802081 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:58.802081 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:58.802081 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:58.802081 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:58.852609 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Getting quotas for project 292206066242490ea4203c5271591b65. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:22:58.868531 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Getting quotas for user bcc121d78e6645d59b0fb856dec9e102 and project 292206066242490ea4203c5271591b65. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:22:58.913997 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] [instance: 573e7e6f-2e64-4fcf-9ae5-f529f492cc60] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:22:58.916989 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:58.917885 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:59.154496 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] [instance: 573e7e6f-2e64-4fcf-9ae5-f529f492cc60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:22:59.155758 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:59.156161 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:22:59.492260 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:22:59.492953 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a04d3e7a-c6ee-480a-aa8c-fd55897a736d tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:19.781050 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:23:19.833014 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:19.833581 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:20.170834 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:20.171257 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:20.172029 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:20.172802 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:20.198212 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Getting quotas for project d7ea37242a6f45dcada688ad7c7a4161. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:23:20.203428 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Getting quotas for user 7e2a6f4fa64a4c8f8a1600cbf08d406f and project d7ea37242a6f45dcada688ad7c7a4161. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:23:20.217633 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] [instance: d6641ee4-d4a6-4c53-bec8-fe45c03dd37b] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:23:20.219001 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:20.220211 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:20.278145 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] [instance: d6641ee4-d4a6-4c53-bec8-fe45c03dd37b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:23:20.283466 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:20.284793 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:20.710785 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:20.719553 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-782ae20f-a5e7-4e61-b92f-a32ee345dc67 tempest-ServerTagsTestJSON-600928449 tempest-ServerTagsTestJSON-600928449-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:21.086519 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:23:22.666674 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Took 0.94 seconds to select destinations for 2 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:23:22.715513 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:22.716112 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:22.982686 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:22.982686 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:23.166765 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:23.169864 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:23.169864 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:23.170099 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:23.197624 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Getting quotas for project 78ad622894b4459d9fef08c861a26384. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:23:23.202967 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Getting quotas for user 5df39fac0d684f998a70533abd7f3424 and project 78ad622894b4459d9fef08c861a26384. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:23:23.217491 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] [instance: 4630c7d6-5faa-442e-ba2d-9a45b31ece30] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:23:23.218690 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:23.219369 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:23.314893 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] [instance: 4630c7d6-5faa-442e-ba2d-9a45b31ece30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:23:23.316638 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:23.317110 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:23.650192 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:23.651192 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:23.673800 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] [instance: bf11da5c-41ec-42c2-a359-311dbf342bbd] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:23:23.675175 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:23.675614 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:23.751820 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] [instance: bf11da5c-41ec-42c2-a359-311dbf342bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:23:23.751820 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:23.751820 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:24.141277 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:24.142042 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a39f209f-62ed-4222-bd76-751e9a0423db tempest-MultipleCreateTestJSON-422046596 tempest-MultipleCreateTestJSON-422046596-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:27.907632 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:23:27.971228 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:27.980089 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:28.219201 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:28.219863 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:28.221143 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:28.221904 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:28.270909 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Getting quotas for project 7ee858be29ea47c79980ba5dcbe08bde. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:23:28.287749 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Getting quotas for user 2a96fe5c76104845826acf5eab50c055 and project 7ee858be29ea47c79980ba5dcbe08bde. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:23:28.305241 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] [instance: a3d9417c-0f20-4c32-ab90-3db17704db96] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:23:28.306197 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:28.306608 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:28.399832 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] [instance: a3d9417c-0f20-4c32-ab90-3db17704db96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:23:28.401434 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:28.402043 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:28.660071 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:28.660476 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-99451d5f-e283-4672-8849-a97c122b327e tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:42.019507 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:23:43.045528 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 46454. Sep 15 03:23:51.333167 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:23:51.375282 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:51.375811 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:51.511978 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:51.512417 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:51.513175 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:51.513578 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:51.537643 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Getting quotas for project 7ee858be29ea47c79980ba5dcbe08bde. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:23:51.539724 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Getting quotas for user 2a96fe5c76104845826acf5eab50c055 and project 7ee858be29ea47c79980ba5dcbe08bde. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:23:51.560835 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] [instance: 618cd3bb-7927-4f24-986a-9482ca3c9c27] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:23:51.562178 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:51.563365 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:51.645185 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] [instance: 618cd3bb-7927-4f24-986a-9482ca3c9c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:23:51.647874 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:51.648335 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:23:52.250451 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:23:52.250752 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a269d73-a1db-4dca-b3de-cecc9f955099 tempest-ServersAdminNegativeTestJSON-895393856 tempest-ServersAdminNegativeTestJSON-895393856-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:06.339091 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Took 0.98 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:24:06.376983 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:06.377399 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:06.783973 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:06.787007 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:06.788811 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:06.791621 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:06.845264 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Getting quotas for project 461d26ca4a484f3397a20c82c30b0f18. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:24:06.860484 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Getting quotas for user 72a51f5fd08c446aa35db224c43e2ff6 and project 461d26ca4a484f3397a20c82c30b0f18. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:24:06.891370 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] [instance: 969720e5-a1fe-4299-b3b4-9f32cfa16ff7] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:24:06.892678 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:06.895633 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:06.909828 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:24:06.946732 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:06.949508 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:07.013955 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] [instance: 969720e5-a1fe-4299-b3b4-9f32cfa16ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:24:07.015494 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:07.016066 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:07.197548 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:07.198170 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:07.202398 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:07.203199 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:07.246471 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Getting quotas for project 461d26ca4a484f3397a20c82c30b0f18. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:24:07.254187 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Getting quotas for user 72a51f5fd08c446aa35db224c43e2ff6 and project 461d26ca4a484f3397a20c82c30b0f18. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:24:07.265025 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] [instance: a147e211-b52f-4b4c-bb4f-be9a695d7bf7] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:24:07.266055 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:07.266854 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:07.436795 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] [instance: a147e211-b52f-4b4c-bb4f-be9a695d7bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:24:07.441611 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:07.441611 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:07.467347 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:07.467952 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-43f92efd-da3e-464d-905c-e0ef1d20b876 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:07.904388 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:07.904757 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bed94c38-675e-420f-b0b0-02c59efbaca8 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:16.245848 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-f7beffdc-6702-4239-a2ab-f52915aa2b74 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method rebuild_instance {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:24:16.248127 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f7beffdc-6702-4239-a2ab-f52915aa2b74 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:16.250048 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-f7beffdc-6702-4239-a2ab-f52915aa2b74 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:16.352993 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-f7beffdc-6702-4239-a2ab-f52915aa2b74 tempest-ServerShowV247Test-1713625685 tempest-ServerShowV247Test-1713625685-project] [instance: a147e211-b52f-4b4c-bb4f-be9a695d7bf7] No migration record for the rebuild/evacuate request. {{(pid=101396) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1127}} Sep 15 03:24:24.024913 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:24:24.072404 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:24.072782 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:24.312399 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:24.312809 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:24.313537 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:24.313942 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:24.331258 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Getting quotas for project 0fc8d1e3d5e04baca28fe5c888e34c1e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:24:24.337523 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Getting quotas for user ff5c0925b5a0443784c61c6bb91f5242 and project 0fc8d1e3d5e04baca28fe5c888e34c1e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:24:24.356178 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] [instance: 3626d0fd-73dc-4e42-a125-1979b14fbeec] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:24:24.358212 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:24.358792 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:24.443953 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] [instance: 3626d0fd-73dc-4e42-a125-1979b14fbeec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:24:24.445205 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:24.445651 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:24.793355 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:24.793748 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-72d41e7a-45ec-4d3a-8223-4e136851cc3f tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:36.117229 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:36.119103 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:36.889812 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:24:36.917764 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:36.918141 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:37.186210 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:37.186210 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:37.186210 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:37.186210 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:37.202229 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Getting quotas for project 303cb113174947c487f2f5104152f0e0. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:24:37.207561 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Getting quotas for user 63651721590d47cc891693d6b4a0b56f and project 303cb113174947c487f2f5104152f0e0. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:24:37.218716 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] [instance: dadfdbba-e4c3-4f34-9ebe-a51f66236f24] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:24:37.219962 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:37.220536 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:37.313020 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] [instance: dadfdbba-e4c3-4f34-9ebe-a51f66236f24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:24:37.314625 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:37.315203 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:24:37.642831 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:24:37.643464 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-60fff889-468e-4ecc-8ba4-66f96ceadd1a tempest-ServerGroupTestJSON-861298019 tempest-ServerGroupTestJSON-861298019-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.269371 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:25:06.313479 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.314177 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.385659 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:25:06.449963 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.450390 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.519590 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.521300 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.522143 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.525294 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.550183 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Getting quotas for project 7f909f5c42c541508d116a37d817a886. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:25:06.556192 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Getting quotas for user 5833632e7f8d483fa3a688dcc9495738 and project 7f909f5c42c541508d116a37d817a886. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:25:06.569941 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] [instance: 533890ee-fe3f-4a65-813d-6c6dad0bdfbe] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:25:06.572161 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.572917 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.697425 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] [instance: 533890ee-fe3f-4a65-813d-6c6dad0bdfbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:25:06.698674 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.699078 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.755099 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.755345 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.756070 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.756779 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.779664 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Getting quotas for project a32fa325fd474dd2947d65e91a35aafc. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:25:06.787529 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Getting quotas for user a0c68ba2d541404487bc4182e6f24e8d and project a32fa325fd474dd2947d65e91a35aafc. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:25:06.801274 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] [instance: 89f1981c-3c03-4bea-8131-c54116ac60a2] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:25:06.802248 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.802657 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:06.946976 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] [instance: 89f1981c-3c03-4bea-8131-c54116ac60a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:25:06.948330 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:06.948741 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:07.328489 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:07.328489 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-62c3ca4d-d9be-4b79-b6f0-a53a6ac5b148 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:07.478751 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:07.479400 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-cb9093a1-aa9a-46cd-88f3-e6f7face33c3 tempest-ServerMetadataNegativeTestJSON-1592068025 tempest-ServerMetadataNegativeTestJSON-1592068025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:07.871094 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:25:07.904423 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:07.905149 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:08.139430 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:08.145114 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:08.145114 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:08.145114 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:08.180452 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Getting quotas for project cb9ab44d7a9d485a9a69640604edee71. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:25:08.188350 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Getting quotas for user ce86a49a32514300b174091207312a83 and project cb9ab44d7a9d485a9a69640604edee71. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:25:08.205868 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] [instance: 2db23a5d-3123-4032-b201-676f266a729c] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:25:08.206818 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:08.207217 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:08.319676 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] [instance: 2db23a5d-3123-4032-b201-676f266a729c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:25:08.322114 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:08.323458 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:08.641331 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:08.642512 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-89f94d4a-1a26-42ee-918e-4d750e5e124c tempest-VolumesBackupsTest-1338253617 tempest-VolumesBackupsTest-1338253617-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:11.130260 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:25:11.168297 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:11.168702 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:11.474995 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:11.475427 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:11.486706 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:11.487997 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:11.509689 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Getting quotas for project 1ab050349a574f16bcc4e96f70d4f2db. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:25:11.516005 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Getting quotas for user b72a8b3780b8445ea6b83546f762d488 and project 1ab050349a574f16bcc4e96f70d4f2db. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:25:11.543668 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] [instance: b597e960-1d62-4f6f-aeb7-f19fdd69f660] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:25:11.545198 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:11.545900 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:11.605127 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] [instance: b597e960-1d62-4f6f-aeb7-f19fdd69f660] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:25:11.606878 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:11.608128 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:12.029661 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:12.030035 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33bd74ff-676a-41d9-aa73-3b680cc1d5c6 tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:22.142846 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:25:23.168827 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49388. Sep 15 03:25:24.502374 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:25:24.521567 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:24.521967 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:24.644730 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:24.645132 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:24.646763 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:24.647160 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:24.672569 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Getting quotas for project 7f909f5c42c541508d116a37d817a886. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:25:24.678103 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Getting quotas for user 5833632e7f8d483fa3a688dcc9495738 and project 7f909f5c42c541508d116a37d817a886. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:25:24.695589 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] [instance: 3db2b09f-7e1c-4e64-8742-4f245dfa0259] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:25:24.696763 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:24.697173 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:24.804395 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] [instance: 3db2b09f-7e1c-4e64-8742-4f245dfa0259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:25:24.805647 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:24.806050 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:25.078526 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:25.078927 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-374621a6-e13f-4b03-9ebf-28d1b1104df7 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:37.802663 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:25:54.781023 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:25:54.838852 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:54.855675 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:55.069274 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:55.069803 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:55.070616 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:55.071003 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:55.126585 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Getting quotas for project 1ab050349a574f16bcc4e96f70d4f2db. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:25:55.142047 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Getting quotas for user b72a8b3780b8445ea6b83546f762d488 and project 1ab050349a574f16bcc4e96f70d4f2db. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:25:55.164256 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] [instance: aa974179-256b-42b9-a121-893fad75fc97] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:25:55.185330 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:55.185737 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:55.265841 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] [instance: aa974179-256b-42b9-a121-893fad75fc97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:25:55.267097 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:55.267811 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:25:55.574831 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:25:55.575641 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-79dfc187-487e-417f-ab9e-a3f24279666d tempest-ServersTestMultiNic-2040055435 tempest-ServersTestMultiNic-2040055435-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:18.757123 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:26:18.792129 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:18.799186 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:19.025942 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:19.026376 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:19.042208 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:19.042208 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:19.094706 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Getting quotas for project 0f95947e6e5742ccb7e7681856101554. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:26:19.103028 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Getting quotas for user 341101b7d4464e70a2916d1e86409ffc and project 0f95947e6e5742ccb7e7681856101554. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:26:19.132611 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] [instance: bda9e5e3-b3f4-45ba-b8e1-19dd1da154a1] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:26:19.133588 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:19.133991 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:19.213709 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] [instance: bda9e5e3-b3f4-45ba-b8e1-19dd1da154a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:26:19.215304 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:19.215889 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:19.494529 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:19.495173 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-159ff5c4-0393-4df9-8a5d-ad38bebd2f35 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:41.108391 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:26:43.046369 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:26:44.078828 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51872. Sep 15 03:26:46.009757 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-fdc57a67-aa00-427e-9744-b0ecec56d9e7 tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method unshelve_instance {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:26:46.010388 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fdc57a67-aa00-427e-9744-b0ecec56d9e7 tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:46.010879 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-fdc57a67-aa00-427e-9744-b0ecec56d9e7 tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:46.937458 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-fdc57a67-aa00-427e-9744-b0ecec56d9e7 tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] [instance: 573e7e6f-2e64-4fcf-9ae5-f529f492cc60] Requesting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) during scheduling {{(pid=101396) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:927}} Sep 15 03:26:47.133987 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:26:47.156125 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:47.156522 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:47.314796 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-fdc57a67-aa00-427e-9744-b0ecec56d9e7 tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:26:47.327979 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-fdc57a67-aa00-427e-9744-b0ecec56d9e7 tempest-AttachVolumeShelveTestJSON-1863153033 tempest-AttachVolumeShelveTestJSON-1863153033-project] Lazy-loading 'flavor' on Instance uuid 573e7e6f-2e64-4fcf-9ae5-f529f492cc60 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:26:47.330492 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:47.330972 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:47.332649 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:47.333237 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:47.357535 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Getting quotas for project 4252b1cb480b4616bc70738f89219cdd. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:26:47.362722 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Getting quotas for user d537d856bb564041b01cfd24340e6ac8 and project 4252b1cb480b4616bc70738f89219cdd. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:26:47.376815 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] [instance: acabe8b8-9b1b-42d2-b9c6-681cb1015ad5] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:26:47.381390 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:47.381390 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:47.466963 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] [instance: acabe8b8-9b1b-42d2-b9c6-681cb1015ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:26:47.468643 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:47.469194 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:26:47.740395 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:26:47.740848 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-243a0c94-8742-40fd-b41a-240bb376ddc1 tempest-ServerAddressesTestJSON-696896855 tempest-ServerAddressesTestJSON-696896855-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:27:12.042710 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-820ffee5-f0cf-41fb-ae1a-ac9f897cef51 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method unshelve_instance {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:27:12.044000 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-820ffee5-f0cf-41fb-ae1a-ac9f897cef51 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:27:12.044888 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-820ffee5-f0cf-41fb-ae1a-ac9f897cef51 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:27:12.468348 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-820ffee5-f0cf-41fb-ae1a-ac9f897cef51 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] [instance: 533890ee-fe3f-4a65-813d-6c6dad0bdfbe] Requesting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) during scheduling {{(pid=101396) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:927}} Sep 15 03:27:12.883420 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-820ffee5-f0cf-41fb-ae1a-ac9f897cef51 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:27:12.894727 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-820ffee5-f0cf-41fb-ae1a-ac9f897cef51 tempest-ServersNegativeTestJSON-1676649180 tempest-ServersNegativeTestJSON-1676649180-project] Lazy-loading 'flavor' on Instance uuid 533890ee-fe3f-4a65-813d-6c6dad0bdfbe {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:27:39.637549 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:27:39.660381 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:27:39.661054 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:27:39.969349 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:27:39.969768 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:27:39.970630 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:27:39.971024 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:27:40.027113 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Getting quotas for project e97b32f39db64cd2ac603742bfd19029. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:27:40.040332 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Getting quotas for user 74adb3aaae1540e591394c820706030e and project e97b32f39db64cd2ac603742bfd19029. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:27:40.070446 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] [instance: 1f9c8633-41bf-4d48-9b04-a471f002c5ab] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:27:40.071693 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:27:40.072120 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:27:40.153704 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] [instance: 1f9c8633-41bf-4d48-9b04-a471f002c5ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:27:40.155165 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:27:40.155703 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:27:40.440823 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:27:40.441124 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bf4eaf80-90c5-4037-a342-1c3fec12dbc7 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:01.924345 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:28:01.970846 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:01.971330 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:02.136075 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:02.137176 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:02.138061 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:02.139748 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:02.184426 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Getting quotas for project 0f95947e6e5742ccb7e7681856101554. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:28:02.197573 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Getting quotas for user 341101b7d4464e70a2916d1e86409ffc and project 0f95947e6e5742ccb7e7681856101554. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:28:02.227367 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] [instance: f600ba4d-f97e-496a-b9bb-38c584c67d69] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:28:02.229274 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:02.232156 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:02.307729 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] [instance: f600ba4d-f97e-496a-b9bb-38c584c67d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:28:02.309872 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:02.310535 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:02.588892 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:02.589304 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-06698f76-6bb4-4e48-8026-059729b35f79 tempest-TestSecurityGroupsBasicOps-974131025 tempest-TestSecurityGroupsBasicOps-974131025-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:15.277700 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:28:15.301412 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:15.305533 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:15.438742 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:15.439916 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:15.440440 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:15.441072 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:15.510517 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Getting quotas for project e97b32f39db64cd2ac603742bfd19029. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:28:15.521725 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Getting quotas for user 74adb3aaae1540e591394c820706030e and project e97b32f39db64cd2ac603742bfd19029. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:28:15.551571 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] [instance: 57b069d4-c89f-496f-9661-9f0b2a5677b0] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:28:15.555541 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:15.555541 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:15.632467 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] [instance: 57b069d4-c89f-496f-9661-9f0b2a5677b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:28:15.633775 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:15.634358 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:15.913792 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:15.914430 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-22da48cf-1e2a-4cf3-8c56-52f599936e39 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:23.167311 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:28:24.186203 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55008. Sep 15 03:28:43.681922 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:28:43.733136 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:43.733536 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:43.929022 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:43.929688 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:43.930745 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:43.932027 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:43.950150 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Getting quotas for project e97b32f39db64cd2ac603742bfd19029. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:28:43.956688 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Getting quotas for user 74adb3aaae1540e591394c820706030e and project e97b32f39db64cd2ac603742bfd19029. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:28:43.971504 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] [instance: 405679cd-388b-4ad0-85f4-bd654ea45d30] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:28:43.973791 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:43.974385 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:44.072263 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] [instance: 405679cd-388b-4ad0-85f4-bd654ea45d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:28:44.076771 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:44.076771 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:44.399293 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:28:44.399927 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6742b3ef-9c13-43fe-9f1f-8bcce208dfa6 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:28:57.825564 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:29:29.551557 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:29:29.598653 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:29.600192 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:29.752632 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:29.753346 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:29.754155 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:29.754722 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:29.783282 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Getting quotas for project e97b32f39db64cd2ac603742bfd19029. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:29:29.787968 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Getting quotas for user 74adb3aaae1540e591394c820706030e and project e97b32f39db64cd2ac603742bfd19029. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:29:29.846253 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] [instance: 6b238d04-93c6-40e8-9e26-f59627eb2466] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:29:29.846253 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:29.846253 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:29.968557 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] [instance: 6b238d04-93c6-40e8-9e26-f59627eb2466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:29:29.970071 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:29.970612 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:30.293122 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:30.295432 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7cfa604a-17d8-4a03-adfc-f9bef522d770 tempest-AttachVolumeNegativeTest-1569186362 tempest-AttachVolumeNegativeTest-1569186362-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:44.076043 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:29:45.093944 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57450. Sep 15 03:29:58.453091 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:29:58.486594 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:58.487003 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:58.722743 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:58.723070 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:58.724009 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:58.724560 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:58.747440 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Getting quotas for project 1b32075cb6d44e7ca5d0261fe47189b4. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:29:58.748171 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Getting quotas for user 395e15fae3284d018632ac276c2a8582 and project 1b32075cb6d44e7ca5d0261fe47189b4. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:29:58.759861 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] [instance: 4f4982b3-85db-4d91-99a6-2ef436d32cb5] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:29:58.760879 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:58.761356 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:58.852815 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] [instance: 4f4982b3-85db-4d91-99a6-2ef436d32cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:29:58.852815 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:58.853228 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:29:59.189719 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:29:59.190314 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-66ea929d-014b-4480-9772-de9d2f4ca748 tempest-VolumesActionsTest-1032801824 tempest-VolumesActionsTest-1032801824-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:30:01.133667 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:30:19.887700 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:30:19.958164 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:30:19.958564 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:30:20.195613 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:30:20.196309 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:30:20.197260 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:30:20.197763 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:30:20.228567 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Getting quotas for project 0fc8d1e3d5e04baca28fe5c888e34c1e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:30:20.236483 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Getting quotas for user ff5c0925b5a0443784c61c6bb91f5242 and project 0fc8d1e3d5e04baca28fe5c888e34c1e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:30:20.257200 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] [instance: d6b63691-a701-4ee9-936d-d4bacdf7e362] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:30:20.257200 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:30:20.257200 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:30:20.351873 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] [instance: d6b63691-a701-4ee9-936d-d4bacdf7e362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:30:20.354292 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:30:20.355872 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:30:20.633723 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:30:20.634273 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5eaf51b5-ff7e-43db-8ddc-2084aba8a4d5 tempest-AttachVolumeTestJSON-1587783339 tempest-AttachVolumeTestJSON-1587783339-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:31:24.186919 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:31:25.214580 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59886. Sep 15 03:32:09.336976 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:32:10.182668 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:32:10.233922 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:32:10.234348 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:32:10.390411 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33194. Sep 15 03:32:10.492638 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:32:10.493552 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:32:10.494711 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:32:10.495336 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:32:10.518923 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Getting quotas for project b5dc106d70274d81b3b1d0751157b7be. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:32:10.525745 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Getting quotas for user 121a3ff742374c85a8bc39c26825cff6 and project b5dc106d70274d81b3b1d0751157b7be. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:32:10.546139 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] [instance: bced9860-9f35-471b-bf24-371239fd9b3f] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:32:10.547700 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:32:10.548511 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:32:10.626534 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] [instance: bced9860-9f35-471b-bf24-371239fd9b3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:32:10.629591 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:32:10.630012 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:32:11.004368 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:32:11.004974 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-3eba108e-0af4-4c10-a6bd-3a4b8ac7ae5b tempest-ServerRescueTestJSONUnderV235-1768379326 tempest-ServerRescueTestJSONUnderV235-1768379326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:32:17.850778 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:32:42.293172 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:32:43.318010 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34220. Sep 15 03:32:45.094888 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:32:46.121303 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34244. Sep 15 03:33:21.163600 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:33:49.555672 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Took 1.05 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:33:49.575685 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:33:49.576130 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:33:49.911590 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:33:49.913121 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:33:49.914209 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:33:49.915248 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:33:49.940669 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Getting quotas for project aac0a9bde44549cfba272a2654b8f9db. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:33:49.945254 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Getting quotas for user c1b30e6286984304ab573341d3b7c027 and project aac0a9bde44549cfba272a2654b8f9db. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:33:49.963462 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] [instance: 21407998-f43d-43ac-ac20-a253d8f57980] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:33:49.964633 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:33:49.965294 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:33:50.125068 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] [instance: 21407998-f43d-43ac-ac20-a253d8f57980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:33:50.126657 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:33:50.127685 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:33:50.604752 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:33:50.605449 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-d702a89e-02a2-4550-829a-8b628cce0a77 tempest-TestServerAdvancedOps-892051810 tempest-TestServerAdvancedOps-892051810-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:34:25.214014 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:34:26.238334 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 36876. Sep 15 03:35:03.809777 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 03:35:04.828355 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37772. Sep 15 03:35:08.221226 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Took 4.42 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:35:08.248940 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:35:08.249456 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:35:08.673323 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:35:08.673962 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:35:08.675551 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:35:08.676107 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:35:08.702298 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:35:08.707643 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for user 479094ac92d2499988c0453f0d24e297 and project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:35:08.720796 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 103148bf-39be-4725-89dc-878fb40a7e0f] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:35:08.721738 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:35:08.722265 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:35:08.873142 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 103148bf-39be-4725-89dc-878fb40a7e0f] block_device_mapping [BlockDeviceMapping(attachment_id=6a87eca5-1eb0-46b4-b8b2-924b5d74385f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fb8928f-aefa-42c6-81db-f51304da5cd0',volume_size=1,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:35:08.874552 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:35:08.874981 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:35:09.326587 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:35:09.327888 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:35:09.337086 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [597b04df-2609-4fb0-9478-82263fb6ff73] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 03:35:10.369811 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-6bb45a15-5959-49cd-b02d-bb9f4e219156 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [597b04df-2609-4fb0-9478-82263fb6ff73] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37942. Sep 15 03:35:37.874075 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:35:46.119825 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:35:47.149500 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39212. Sep 15 03:36:09.248020 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:36:10.300850 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40260. Sep 15 03:36:25.879985 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:36:26.910685 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40754. Sep 15 03:36:33.293862 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:36:33.312984 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:36:33.313425 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:36:33.507739 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:36:33.508347 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:36:33.509957 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:36:33.510500 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:36:33.530552 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:36:33.536077 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for user 479094ac92d2499988c0453f0d24e297 and project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:36:33.549788 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 6b1d7061-e3d7-4401-9dae-39411a02b9e6] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:36:33.550955 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:36:33.551604 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:36:33.637466 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 6b1d7061-e3d7-4401-9dae-39411a02b9e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='79c6df3c-b684-4709-baef-5a38ad97a1a1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:36:33.638852 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:36:33.639271 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:36:34.090586 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:36:34.091040 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-33db5fde-a18c-488d-9d39-9de2f4423ef7 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:36:41.225571 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:36:45.891567 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:36:47.911693 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:37:26.240317 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:37:27.258854 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42498. Sep 15 03:38:43.321791 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:38:44.349864 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44766. Sep 15 03:38:46.175469 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:38:46.218165 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:38:46.221294 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:38:46.407039 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:38:46.407949 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:38:46.408828 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:38:46.409374 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:38:46.456186 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:38:46.473474 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for user 479094ac92d2499988c0453f0d24e297 and project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:38:46.547319 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 3946aa5d-a2ac-4866-bab7-6de03ccdd1cd] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:38:46.547319 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:38:46.547319 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:38:46.665607 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 3946aa5d-a2ac-4866-bab7-6de03ccdd1cd] block_device_mapping [BlockDeviceMapping(attachment_id=a0dde71f-932b-4a46-bec2-9845d15e1c4e,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36757ed1-861c-42b5-9d2e-efa46996744f',volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:38:46.666904 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:38:46.667302 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:38:47.148557 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:38:47.432767 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:38:47.432767 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-45a675c9-ba38-4f35-a231-46ed52ab20fd tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:38:48.170636 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44868. Sep 15 03:38:57.900022 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:39:10.381455 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:39:11.490651 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45612. Sep 15 03:39:15.629840 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:39:15.659252 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:39:15.660100 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:39:15.943615 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:39:15.944026 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:39:15.944762 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:39:15.945280 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:39:15.961294 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:39:15.966422 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for user 479094ac92d2499988c0453f0d24e297 and project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:39:15.981478 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: a426dc44-c604-42df-bfba-8429750d3dbc] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:39:15.982446 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:39:15.982961 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:39:16.095941 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: a426dc44-c604-42df-bfba-8429750d3dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6e2a6de4-d995-481d-b01c-005cf5a11ed1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:39:16.097391 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:39:16.097905 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:39:16.512345 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:39:16.513081 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bee4be72-4bf2-41ea-a476-d08162209814 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:01.259410 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:40:14.131425 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:40:14.153402 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:14.153402 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:14.446682 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:14.447201 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:14.448159 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:14.448947 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:14.466115 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Getting quotas for project d71b3367f02f4e0693db87277a0bde58. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:40:14.483833 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Getting quotas for user 38ad8600fe824c069c9c1448b944942a and project d71b3367f02f4e0693db87277a0bde58. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:40:14.495866 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] [instance: e15faf34-16db-4fff-b61c-cd297ffc18ab] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:40:14.496824 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:14.497231 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:14.612134 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] [instance: e15faf34-16db-4fff-b61c-cd297ffc18ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:40:14.613869 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:14.614259 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:14.994894 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:14.995995 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ffa2f2cb-3db8-456b-894e-196efa686514 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:19.918112 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:40:19.949806 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:19.951259 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:20.270954 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:20.271721 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:20.272628 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:20.273025 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:20.289469 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Getting quotas for project 585881ffbb804f4895950c29067db89e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:40:20.294721 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Getting quotas for user f16b1fd782044c92892b40cffa63924f and project 585881ffbb804f4895950c29067db89e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:40:20.307258 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] [instance: 7f43d6a5-8348-44cf-89ff-84e4e7e08b8a] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:40:20.308888 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:20.309652 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:20.462817 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] [instance: 7f43d6a5-8348-44cf-89ff-84e4e7e08b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:40:20.465212 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:20.465745 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:21.228746 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:40:21.228746 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-699a9357-078b-4805-8ed5-054c88766c18 tempest-VolumesNegativeTest-628937536 tempest-VolumesNegativeTest-628937536-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:40:27.257168 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:40:28.278090 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48298. Sep 15 03:41:08.040839 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:41:08.064710 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:08.065116 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:08.287186 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:08.287919 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:08.289039 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:08.289594 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:08.306967 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Getting quotas for project 355f04d9afed46328806b6b1edab142e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:41:08.311843 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Getting quotas for user 3bd49316cfb541a0b3f70363113b29f8 and project 355f04d9afed46328806b6b1edab142e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:41:08.323062 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] [instance: ae6e5163-92a8-4ace-80d5-e20c73cd04ea] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:41:08.324235 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:08.324907 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:08.412964 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] [instance: ae6e5163-92a8-4ace-80d5-e20c73cd04ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:41:08.414329 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:08.414808 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:08.689157 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:08.690458 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-36caa89a-4068-41f5-b822-b677a1f8d517 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:32.446990 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:41:32.466144 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:32.466544 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:32.610379 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:32.610780 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:32.611530 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:32.611912 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:32.627333 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:41:32.631707 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for user 479094ac92d2499988c0453f0d24e297 and project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:41:32.642650 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 5045d9dc-8194-4531-b3a9-7bd8e2682ff2] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:41:32.643514 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:32.643914 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:32.743451 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 5045d9dc-8194-4531-b3a9-7bd8e2682ff2] block_device_mapping [BlockDeviceMapping(attachment_id=427a721b-dc99-49d5-842c-707e800191fc,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2809073e-2929-41af-a03f-da593b45aa07',volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:41:32.745221 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:32.745623 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:33.048873 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:33.049309 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7eb06e6-ae2a-4042-946f-dd2e60945fed tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:47.309253 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:41:47.329744 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:47.330361 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:47.496551 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:47.496871 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:47.497580 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:47.497969 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:47.513461 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Getting quotas for project d71b3367f02f4e0693db87277a0bde58. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:41:47.518577 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Getting quotas for user 38ad8600fe824c069c9c1448b944942a and project d71b3367f02f4e0693db87277a0bde58. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:41:47.529473 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] [instance: b5c1670e-ddab-454f-9c99-eba56e277ec8] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:41:47.530364 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:47.530760 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:47.611812 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] [instance: b5c1670e-ddab-454f-9c99-eba56e277ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:41:47.613079 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:47.613485 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:47.864593 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:41:47.865004 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7f770230-ffad-40ee-92f6-eb590f552347 tempest-VolumesSnapshotTestJSON-443602854 tempest-VolumesSnapshotTestJSON-443602854-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:41:48.170454 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:41:49.186634 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49770. Sep 15 03:42:07.919625 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:42:07.937738 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:07.942308 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:08.101841 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:08.102174 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:08.102904 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:08.103319 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:08.117662 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Getting quotas for project db34522a4fbd42df8f21186f7271acd3. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:42:08.122178 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Getting quotas for user b002fdac151746e88233cd8ffb251247 and project db34522a4fbd42df8f21186f7271acd3. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:42:08.132524 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] [instance: 67d66fb3-74e7-4311-a15f-a7b410a902c2] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:42:08.137582 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:08.137582 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:08.205871 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] [instance: 67d66fb3-74e7-4311-a15f-a7b410a902c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:42:08.207124 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:08.207564 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:08.373306 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:08.373741 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-55f3f365-ee4f-4d1e-bad7-7cb4fbf770cd tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:17.914110 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:42:26.017001 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:42:26.035177 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:26.035605 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:26.159134 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:26.159576 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:26.160312 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:26.160703 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:26.176682 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Getting quotas for project db34522a4fbd42df8f21186f7271acd3. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:42:26.181289 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Getting quotas for user b002fdac151746e88233cd8ffb251247 and project db34522a4fbd42df8f21186f7271acd3. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:42:26.193060 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] [instance: 38f8a51c-9949-45e1-8116-3111d4fabfb6] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:42:26.194016 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:26.194503 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:26.268565 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] [instance: 38f8a51c-9949-45e1-8116-3111d4fabfb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:42:26.269853 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:26.270254 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:26.556283 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:26.556607 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-a3c78b47-f4c4-442e-ac9f-efde8cd8b6b1 tempest-VolumesActionsTest-1666628971 tempest-VolumesActionsTest-1666628971-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:40.016426 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:42:40.036526 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:40.036932 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:40.159883 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:40.164646 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:40.164646 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:40.164646 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:40.176537 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Getting quotas for project 355f04d9afed46328806b6b1edab142e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:42:40.181289 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Getting quotas for user 3bd49316cfb541a0b3f70363113b29f8 and project 355f04d9afed46328806b6b1edab142e. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:42:40.192273 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] [instance: 998429b3-e0d9-457a-93b9-db62abace1b5] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:42:40.193193 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:40.193587 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:40.245716 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] [instance: 998429b3-e0d9-457a-93b9-db62abace1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:42:40.246982 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:40.247404 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:42:40.528029 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:42:40.528364 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-5ae271b4-594d-404d-b2a4-84039fce8321 tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:43:21.312453 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:43:28.277538 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:43:29.298154 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 50824. Sep 15 03:43:57.834756 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:43:57.853431 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:43:57.853835 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:43:57.973325 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:43:57.975653 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:43:57.976626 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:43:57.977056 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:43:58.017691 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Getting quotas for project 355f04d9afed46328806b6b1edab142e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:43:58.030166 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Getting quotas for user 3bd49316cfb541a0b3f70363113b29f8 and project 355f04d9afed46328806b6b1edab142e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:43:58.041694 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] [instance: 8b2a6a74-0af2-45fa-b780-da60c430a1fa] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:43:58.042721 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:43:58.043805 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:43:58.119922 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] [instance: 8b2a6a74-0af2-45fa-b780-da60c430a1fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:43:58.123764 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:43:58.123764 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:43:58.359758 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:43:58.360168 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-ab39c8a7-9e5b-4ae0-9cc3-1c571887cabe tempest-TestNetworkBasicOps-853812789 tempest-TestNetworkBasicOps-853812789-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:20.972816 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:44:21.009218 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:21.010213 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:21.209015 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:21.209502 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:21.210081 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:21.210523 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:21.265509 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Getting quotas for project ba20aeba93324afdad942723b6495c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:44:21.280898 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Getting quotas for user 93e75d5733984eff92bc482a48f4d404 and project ba20aeba93324afdad942723b6495c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:44:21.306349 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [instance: f97e3891-f218-48c4-a1b2-88d42032e1db] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:44:21.307594 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:21.308714 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:21.409923 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [instance: f97e3891-f218-48c4-a1b2-88d42032e1db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:44:21.410772 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:21.411624 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:21.668986 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:21.669659 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-814e8f55-12fd-4d86-b999-63afa12d462f tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:28.261839 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:44:28.284946 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:28.285584 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:28.485570 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:28.486070 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:28.486859 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:28.487317 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:28.503344 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Getting quotas for project 75dd5496882747c983bcd75347e9cb9e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:44:28.508262 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Getting quotas for user 0382519e61f94647911987887dc17ee3 and project 75dd5496882747c983bcd75347e9cb9e. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:44:28.519662 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] [instance: fb39d91a-ba16-436c-9fd1-067d5f712a20] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:44:28.520880 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:28.521299 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:28.616974 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] [instance: fb39d91a-ba16-436c-9fd1-067d5f712a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:44:28.618203 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:28.618598 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:28.796376 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:28.796967 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-91b9aee9-f012-4e97-a168-59a9d7ef6730 tempest-TestServerBasicOps-1065322442 tempest-TestServerBasicOps-1065322442-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:44.228850 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:44:44.248304 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:44.248713 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:44.398714 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:44.399115 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:44.399874 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:44.400264 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:44.414856 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:44:44.420044 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for user 479094ac92d2499988c0453f0d24e297 and project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:44:44.430152 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 0d1b4ab8-6b96-410e-9641-881b273f4401] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:44:44.431089 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:44.431534 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:44.485442 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 0d1b4ab8-6b96-410e-9641-881b273f4401] block_device_mapping [BlockDeviceMapping(attachment_id=f836b372-3aa1-45ee-aadd-2b80185bdbbb,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2809073e-2929-41af-a03f-da593b45aa07',volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:44:44.486778 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:44.487184 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:44.709746 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:44:44.710142 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-db3d5e27-6a05-430b-93ff-043c734a790d tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:44:49.188779 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:44:50.205036 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51678. Sep 15 03:45:37.931782 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:45:41.367408 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-78bbd53f-d24d-4f97-a015-f2d54f17baee tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:45:41.367905 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-78bbd53f-d24d-4f97-a015-f2d54f17baee tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:45:41.368305 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-78bbd53f-d24d-4f97-a015-f2d54f17baee tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:45:41.678602 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-78bbd53f-d24d-4f97-a015-f2d54f17baee tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] [instance: f97e3891-f218-48c4-a1b2-88d42032e1db] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101396) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 03:45:42.197401 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-78bbd53f-d24d-4f97-a015-f2d54f17baee tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Created allocations for migration 7f42f450-640f-4f10-a92d-d840a0d51825 on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:45:42.583655 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-78bbd53f-d24d-4f97-a015-f2d54f17baee tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] [instance: f97e3891-f218-48c4-a1b2-88d42032e1db] Calling prep_resize with selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101396) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 03:46:29.298740 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:46:30.314097 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51958. Sep 15 03:46:41.334082 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:46:45.929391 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:46:47.963881 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:47:09.561185 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:47:09.586384 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:09.586728 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:09.780867 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:09.781606 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:09.782433 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:09.783050 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:09.810951 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Getting quotas for project ba20aeba93324afdad942723b6495c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:47:09.816535 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Getting quotas for user 93e75d5733984eff92bc482a48f4d404 and project ba20aeba93324afdad942723b6495c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:47:09.829386 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [instance: 8ee58bcc-bb28-47b7-8db4-76402efc3a94] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:47:09.831059 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:09.831863 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:09.902122 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [instance: 8ee58bcc-bb28-47b7-8db4-76402efc3a94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:47:09.903406 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:09.903962 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:10.149715 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:10.150204 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e7e3091b-5cea-4bba-9237-1f444cde4673 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:40.998626 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:47:41.017976 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:41.018379 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:41.135381 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:41.135802 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:41.136520 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:41.136907 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:41.151236 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:47:41.155583 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Getting quotas for user 479094ac92d2499988c0453f0d24e297 and project 16dfbb553da24012b778e7662347cf02. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:47:41.166359 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 5b5e1cf5-0ad0-435e-b71c-42562b28fb15] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:47:41.168530 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:41.168530 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:41.255770 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] [instance: 5b5e1cf5-0ad0-435e-b71c-42562b28fb15] block_device_mapping [BlockDeviceMapping(attachment_id=29c087cd-5fd2-44a0-9065-62ce9adee4e2,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e78998d9-e884-46f7-9465-1d94149013ed',volume_size=1,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:47:41.257048 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:41.257452 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:41.582823 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:47:41.583237 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5517d1c0-3c69-44ae-a795-64a8d5fcbfb6 tempest-TestVolumeBootPattern-507851866 tempest-TestVolumeBootPattern-507851866-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:47:50.205775 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:47:51.223133 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52238. Sep 15 03:48:40.235120 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-c54d7979-462f-4a69-9e20-849408a01e7b tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:48:40.235716 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c54d7979-462f-4a69-9e20-849408a01e7b tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:48:40.236040 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c54d7979-462f-4a69-9e20-849408a01e7b tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:48:40.546848 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-c54d7979-462f-4a69-9e20-849408a01e7b tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] [instance: 8ee58bcc-bb28-47b7-8db4-76402efc3a94] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101395) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 03:48:41.028299 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-c54d7979-462f-4a69-9e20-849408a01e7b tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Created allocations for migration 8fe67ec1-e899-4f4d-ad39-8b573704110c on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:48:41.379539 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-c54d7979-462f-4a69-9e20-849408a01e7b tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] [instance: 8ee58bcc-bb28-47b7-8db4-76402efc3a94] Calling prep_resize with selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101395) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 03:48:57.949614 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:49:30.314809 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:49:31.332361 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52456. Sep 15 03:49:44.354933 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:49:45.370058 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52458. Sep 15 03:50:01.349274 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:50:11.443238 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:50:12.473798 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52594. Sep 15 03:50:22.348208 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:50:23.956233 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:50:39.773382 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:50:39.812053 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:50:39.813068 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:50:40.054791 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:50:40.055710 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:50:40.057279 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:50:40.058003 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:50:40.090748 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Getting quotas for project ba20aeba93324afdad942723b6495c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:50:40.097753 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Getting quotas for user 93e75d5733984eff92bc482a48f4d404 and project ba20aeba93324afdad942723b6495c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:50:40.115624 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [instance: fac4cb20-c58f-48eb-b248-fbd27e212a37] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:50:40.116859 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:50:40.117448 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:50:40.187043 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [instance: fac4cb20-c58f-48eb-b248-fbd27e212a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:50:40.188366 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:50:40.188772 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:50:40.458721 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:50:40.459978 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f5d-aa88-4a49-acb6-1e227967dadf tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:50:51.232937 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:50:52.252873 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52996. Sep 15 03:52:11.360145 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-635850da-30bc-4c2d-b205-8f8c188276e2 tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:52:11.360640 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-635850da-30bc-4c2d-b205-8f8c188276e2 tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:52:11.361033 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-635850da-30bc-4c2d-b205-8f8c188276e2 tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:52:11.952772 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-635850da-30bc-4c2d-b205-8f8c188276e2 tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Created allocations for migration 933026ca-3542-4fce-aab8-a1ec17d9a80b on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:52:12.168092 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.live_migrate [None req-635850da-30bc-4c2d-b205-8f8c188276e2 tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] [instance: fac4cb20-c58f-48eb-b248-fbd27e212a37] Requesting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while live migrating {{(pid=101396) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:492}} Sep 15 03:52:12.585277 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-635850da-30bc-4c2d-b205-8f8c188276e2 tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Lazy-loading 'resources' on Instance uuid fac4cb20-c58f-48eb-b248-fbd27e212a37 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:52:12.589958 chdv-809057-1 nova-conductor[101396]: DEBUG nova.objects.instance [None req-635850da-30bc-4c2d-b205-8f8c188276e2 tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] Lazy-loading 'pci_requests' on Instance uuid fac4cb20-c58f-48eb-b248-fbd27e212a37 {{(pid=101396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 03:52:13.006983 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.live_migrate [None req-635850da-30bc-4c2d-b205-8f8c188276e2 tempest-TestNetworkAdvancedServerOps-1887562685 tempest-TestNetworkAdvancedServerOps-1887562685-project-admin] [instance: fac4cb20-c58f-48eb-b248-fbd27e212a37] Start binding ports on destination host: chh2-809057-1 {{(pid=101396) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:386}} Sep 15 03:52:17.968189 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:52:47.570895 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [5cf8a213-6374-470f-8d38-84ee6ca5eb85] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 03:52:48.590613 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [5cf8a213-6374-470f-8d38-84ee6ca5eb85] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54148. Sep 15 03:52:49.212395 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Took 1.65 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:52:49.237140 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:52:49.237544 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:52:49.440997 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:52:49.441400 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:52:49.442156 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:52:49.442549 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:52:49.461199 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Getting quotas for project ba20aeba93324afdad942723b6495c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:52:49.466987 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Getting quotas for user 93e75d5733984eff92bc482a48f4d404 and project ba20aeba93324afdad942723b6495c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:52:49.481766 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [instance: fef1424d-d52c-4b71-a0f5-968f3fdb636b] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:52:49.483130 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:52:49.483561 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:52:49.572408 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [instance: fef1424d-d52c-4b71-a0f5-968f3fdb636b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:52:49.574262 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:52:49.575111 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:52:49.841986 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:52:49.842662 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:52:49.852012 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [5bfeb9e5-7473-4321-9341-e0d9abd92894] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 03:52:50.869746 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [None req-46c68f55-0fe6-4193-90ea-f10a90c38b2a tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [5bfeb9e5-7473-4321-9341-e0d9abd92894] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54198. Sep 15 03:53:00.896067 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:53:00.915494 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:53:00.915901 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:53:01.049965 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:53:01.050369 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:53:01.051091 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:53:01.051521 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:53:01.066601 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Getting quotas for project ad9c7be6d3324d8888f75577eba74939. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:53:01.072057 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Getting quotas for user adae2a774db3486392350e04c3d1e836 and project ad9c7be6d3324d8888f75577eba74939. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:53:01.082254 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] [instance: ca3bb77e-01c0-4ada-83be-3f63adda3986] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:53:01.083162 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:53:01.083599 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:53:01.131784 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] [instance: ca3bb77e-01c0-4ada-83be-3f63adda3986] block_device_mapping [BlockDeviceMapping(attachment_id=5b59bfdc-d2f6-4cb8-bfd0-83dbd5bdf738,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='535174fc-4389-4d4d-aa0f-134e2d3d001a',volume_size=1,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:53:01.134156 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:53:01.134605 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:53:01.379525 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:53:01.380000 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9c1bb503-eeae-4fad-8a82-65e95ac80221 tempest-TestVolumeBackupRestore-672357111 tempest-TestVolumeBackupRestore-672357111-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:53:21.368499 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:53:52.253726 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:53:53.270439 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54380. Sep 15 03:54:06.527579 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6ff49250-0eef-4d31-953d-7e94e3d24341 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method rebuild_instance {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:54:06.528154 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6ff49250-0eef-4d31-953d-7e94e3d24341 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:54:06.528441 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6ff49250-0eef-4d31-953d-7e94e3d24341 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:54:06.616267 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6ff49250-0eef-4d31-953d-7e94e3d24341 tempest-TestNetworkAdvancedServerOps-898668326 tempest-TestNetworkAdvancedServerOps-898668326-project] [instance: fef1424d-d52c-4b71-a0f5-968f3fdb636b] No migration record for the rebuild/evacuate request. {{(pid=101395) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1127}} Sep 15 03:54:31.333990 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:54:32.354154 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54532. Sep 15 03:55:12.469698 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:55:13.490952 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55012. Sep 15 03:55:22.378819 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:55:23.994731 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:55:26.916112 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:55:27.932323 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55032. Sep 15 03:55:45.374122 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:55:46.391733 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55088. Sep 15 03:56:00.027208 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:56:00.046987 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:00.047267 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:00.231931 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:00.232337 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:00.233266 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:00.233663 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:00.248858 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Getting quotas for project f5e941535daa40fcbe98eedd4738dc22. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:56:00.253376 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Getting quotas for user f9299355c5574acb9d3243766e3a112b and project f5e941535daa40fcbe98eedd4738dc22. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:56:00.265107 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] [instance: 127c4727-fd08-45f3-918f-250d69147eb8] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:56:00.265702 chdv-809057-1 nova-conductor[101395]: DEBUG nova.scheduler.utils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Re-scheduling is disabled due to forcing a host (['chh1-809057-1']) and/or node ([]) {{(pid=101395) populate_retry /opt/stack/nova/nova/scheduler/utils.py:967}} Sep 15 03:56:00.266503 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:00.266897 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:00.323454 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] [instance: 127c4727-fd08-45f3-918f-250d69147eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:56:00.324815 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:00.325216 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:00.553363 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:00.553772 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-c3e45e12-20c0-4488-9334-39ab558ce52f tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:15.681234 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:56:15.699561 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:15.699982 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:15.800995 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:15.801424 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:15.802141 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:15.802528 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:15.817164 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Getting quotas for project f5e941535daa40fcbe98eedd4738dc22. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:56:15.822249 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Getting quotas for user f9299355c5574acb9d3243766e3a112b and project f5e941535daa40fcbe98eedd4738dc22. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:56:15.832771 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] [instance: b32d04b7-c5ad-4617-a6a0-6004bda5837d] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:56:15.833348 chdv-809057-1 nova-conductor[101396]: DEBUG nova.scheduler.utils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Re-scheduling is disabled due to forcing a host (['chh2-809057-1']) and/or node ([]) {{(pid=101396) populate_retry /opt/stack/nova/nova/scheduler/utils.py:967}} Sep 15 03:56:15.834072 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:15.834462 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:15.895551 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] [instance: b32d04b7-c5ad-4617-a6a0-6004bda5837d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:56:15.896693 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:15.897099 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:16.136435 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:16.136834 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e77a85ee-2532-4b1a-9367-ad16a0d997b9 tempest-TestServerMultinode-729054591 tempest-TestServerMultinode-729054591-project-admin] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:41.391583 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:56:53.272691 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:56:54.291857 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55372. Sep 15 03:56:54.749924 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:56:54.768077 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:54.768473 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:54.932539 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:54.932944 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:54.933674 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:54.934063 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:54.949446 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Getting quotas for project 9da7c4933563477f959c46b635eecea6. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:56:54.953799 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Getting quotas for user fd403b95fead41ca8c525a70b4fe7f14 and project 9da7c4933563477f959c46b635eecea6. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:56:54.964654 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] [instance: d82ddea0-b92c-42eb-9c52-378cb80e80aa] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:56:54.965548 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:54.965945 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:55.014354 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] [instance: d82ddea0-b92c-42eb-9c52-378cb80e80aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:56:55.015617 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:55.016023 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:56:55.164201 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:56:55.164607 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a7561432-be6a-4e30-8368-a6aecd4391fd tempest-ServersAdminNegativeTestJSON-1748688455 tempest-ServersAdminNegativeTestJSON-1748688455-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:57:17.987565 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 03:57:18.372438 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:57:18.390397 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:57:18.390802 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:57:18.560786 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:57:18.561105 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:57:18.561817 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:57:18.562207 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:57:18.577675 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Getting quotas for project de470183d4e3480bbdb0783b91d89e2f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:57:18.581951 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Getting quotas for user dbe3c04307404bd1a10b8b7f3168d843 and project de470183d4e3480bbdb0783b91d89e2f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:57:18.592822 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] [instance: b3338a8b-eb11-4165-bd82-2a7f1c87f880] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:57:18.593784 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:57:18.594183 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:57:18.646735 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] [instance: b3338a8b-eb11-4165-bd82-2a7f1c87f880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:57:18.647907 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:57:18.648303 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:57:18.854690 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:57:18.855091 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-22599592-91c2-4292-bc0f-fadb3b88971a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:57:30.742315 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-04998989-3065-417c-ba75-b8ccb970f47a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:57:30.743573 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-04998989-3065-417c-ba75-b8ccb970f47a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:57:30.743778 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-04998989-3065-417c-ba75-b8ccb970f47a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:57:30.960282 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-04998989-3065-417c-ba75-b8ccb970f47a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] [instance: b3338a8b-eb11-4165-bd82-2a7f1c87f880] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101395) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 03:57:31.408791 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-04998989-3065-417c-ba75-b8ccb970f47a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] Created allocations for migration acc69dd2-ef4f-421a-9843-55992110e721 on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:57:31.720934 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-04998989-3065-417c-ba75-b8ccb970f47a tempest-DeleteServersTestJSON-1153343623 tempest-DeleteServersTestJSON-1153343623-project] [instance: b3338a8b-eb11-4165-bd82-2a7f1c87f880] Calling prep_resize with selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"7790447f-ae2c-4619-9754-640c71ce9599": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7790447f-ae2c-4619-9754-640c71ce9599"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=7790447f-ae2c-4619-9754-640c71ce9599,limits=SchedulerLimits,nodename='chh1-809057-1',service_host='chh1-809057-1')] {{(pid=101395) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 03:57:32.354324 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 03:57:33.371867 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55594. Sep 15 03:58:17.051234 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:58:17.073186 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:58:17.073640 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:58:17.215606 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:58:17.216013 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:58:17.216781 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:58:17.217177 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:58:17.231470 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Getting quotas for project e5e184e899f8425ea568685ae72a4535. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:58:17.235895 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Getting quotas for user 3df361d2f73142148bd21cf87b4d950d and project e5e184e899f8425ea568685ae72a4535. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:58:17.246589 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] [instance: 0435ba46-4289-4fa0-8827-3cfd8462e94d] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:58:17.247495 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:58:17.247891 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:58:17.291316 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] [instance: 0435ba46-4289-4fa0-8827-3cfd8462e94d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:58:17.292489 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:58:17.292887 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:58:17.511366 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:58:17.511731 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-18f4167b-b274-4a2e-9c7f-a66bcd30bc39 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:58:30.118086 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-fa2e7219-3053-4218-b321-bcd885b08a03 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:58:30.118582 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fa2e7219-3053-4218-b321-bcd885b08a03 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:58:30.119463 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-fa2e7219-3053-4218-b321-bcd885b08a03 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:58:30.290430 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-fa2e7219-3053-4218-b321-bcd885b08a03 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] [instance: 0435ba46-4289-4fa0-8827-3cfd8462e94d] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101395) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 03:58:30.743697 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-fa2e7219-3053-4218-b321-bcd885b08a03 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Created allocations for migration 7174b594-ea14-499f-a9be-aec8498d07e8 on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:58:31.107195 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-fa2e7219-3053-4218-b321-bcd885b08a03 tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] [instance: 0435ba46-4289-4fa0-8827-3cfd8462e94d] Calling prep_resize with selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"4304e6a0-cb35-42bf-878b-c4da5dd28abd": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["4304e6a0-cb35-42bf-878b-c4da5dd28abd"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=4304e6a0-cb35-42bf-878b-c4da5dd28abd,limits=SchedulerLimits,nodename='chh2-809057-1',service_host='chh2-809057-1')] {{(pid=101395) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 03:59:10.685222 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 03:59:10.703989 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:59:10.704400 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:59:10.798229 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:59:10.798628 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:59:10.799358 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:59:10.799776 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:59:10.815117 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Getting quotas for project e5e184e899f8425ea568685ae72a4535. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 03:59:10.819632 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Getting quotas for user 3df361d2f73142148bd21cf87b4d950d and project e5e184e899f8425ea568685ae72a4535. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 03:59:10.830056 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] [instance: d397159a-8f79-4ecb-90e7-e2e7062497cf] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 03:59:10.830943 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:59:10.831344 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:59:10.894668 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] [instance: d397159a-8f79-4ecb-90e7-e2e7062497cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 03:59:10.895956 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:59:10.896361 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:59:11.143430 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:59:11.143835 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-71bd6051-a22e-4d0b-b08b-3e54530e852b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:59:22.274704 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-9592a4b3-fe54-40ff-b063-f6cc1b69935b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 03:59:22.275220 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9592a4b3-fe54-40ff-b063-f6cc1b69935b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 03:59:22.275579 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-9592a4b3-fe54-40ff-b063-f6cc1b69935b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 03:59:22.493435 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-9592a4b3-fe54-40ff-b063-f6cc1b69935b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] [instance: d397159a-8f79-4ecb-90e7-e2e7062497cf] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101395) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 03:59:22.938347 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-9592a4b3-fe54-40ff-b063-f6cc1b69935b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] Created allocations for migration d994a1c9-afc7-472b-858e-669e96586edb on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 03:59:23.222016 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-9592a4b3-fe54-40ff-b063-f6cc1b69935b tempest-ServerDiskConfigTestJSON-2111228619 tempest-ServerDiskConfigTestJSON-2111228619-project] [instance: d397159a-8f79-4ecb-90e7-e2e7062497cf] Calling prep_resize with selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"4304e6a0-cb35-42bf-878b-c4da5dd28abd": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["4304e6a0-cb35-42bf-878b-c4da5dd28abd"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=4304e6a0-cb35-42bf-878b-c4da5dd28abd,limits=SchedulerLimits,nodename='chh2-809057-1',service_host='chh2-809057-1')] {{(pid=101395) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 03:59:54.290112 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 03:59:55.306116 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56038. Sep 15 04:00:01.411980 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:00:15.534487 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:00:15.553204 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:00:15.553606 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:00:15.730916 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:00:15.731252 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:00:15.732018 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:00:15.732405 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:00:15.747646 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Getting quotas for project 2e066d3bac624f17a86c0749a173a3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:00:15.752634 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Getting quotas for user 738fb8dbf36944c6b8e3a28d085a28f1 and project 2e066d3bac624f17a86c0749a173a3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:00:15.762853 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: c65640a5-f8c5-433b-ac15-d95e8d2c9357] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:00:15.763773 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:00:15.764176 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:00:15.849357 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: c65640a5-f8c5-433b-ac15-d95e8d2c9357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:00:15.850564 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:00:15.850968 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:00:16.111807 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:00:16.112211 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-e01dfde7-2f89-4deb-8cab-0736aaf19875 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:00:33.372068 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:00:34.387272 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56208. Sep 15 04:00:38.005524 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:01:27.936895 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:01:28.956968 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56318. Sep 15 04:02:10.315627 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:02:11.329302 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56414. Sep 15 04:02:46.395883 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:02:47.412324 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56492. Sep 15 04:02:55.307768 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:02:56.315539 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-949bc9dc-ef17-4571-b8df-f7032e5a4ed8 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 04:02:56.316017 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-949bc9dc-ef17-4571-b8df-f7032e5a4ed8 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:02:56.316411 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-949bc9dc-ef17-4571-b8df-f7032e5a4ed8 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:02:56.325531 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56526. Sep 15 04:02:56.603412 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-949bc9dc-ef17-4571-b8df-f7032e5a4ed8 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: c65640a5-f8c5-433b-ac15-d95e8d2c9357] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101396) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 04:02:57.093886 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-949bc9dc-ef17-4571-b8df-f7032e5a4ed8 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Created allocations for migration 63f2bfc5-cf6c-425f-b576-e6073dacafae on 4304e6a0-cb35-42bf-878b-c4da5dd28abd {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 04:02:57.462879 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-949bc9dc-ef17-4571-b8df-f7032e5a4ed8 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: c65640a5-f8c5-433b-ac15-d95e8d2c9357] Calling prep_resize with selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"4304e6a0-cb35-42bf-878b-c4da5dd28abd": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["4304e6a0-cb35-42bf-878b-c4da5dd28abd"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=4304e6a0-cb35-42bf-878b-c4da5dd28abd,limits=SchedulerLimits,nodename='chh2-809057-1',service_host='chh2-809057-1')] {{(pid=101396) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 04:03:21.427775 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:03:32.274063 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:03:32.296556 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:03:32.296966 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:03:32.392803 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:03:32.394155 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:03:32.394902 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:03:32.395298 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:03:32.412697 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Getting quotas for project 2e066d3bac624f17a86c0749a173a3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:03:32.417088 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Getting quotas for user 738fb8dbf36944c6b8e3a28d085a28f1 and project 2e066d3bac624f17a86c0749a173a3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:03:32.427995 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: 3c57b46c-45bb-476e-9ebe-70fdce92dbf0] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:03:32.428903 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:03:32.429305 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:03:32.502623 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: 3c57b46c-45bb-476e-9ebe-70fdce92dbf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:03:32.503859 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:03:32.504255 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:03:32.749738 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:03:32.750137 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4b8200c7-964c-4ec7-8612-eac4232450e3 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:03:34.388581 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:03:35.407104 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56736. Sep 15 04:03:58.021050 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:05:13.493843 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:05:14.514707 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56962. Sep 15 04:05:47.413869 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:05:48.430514 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57026. Sep 15 04:05:56.325606 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:05:57.341708 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57046. Sep 15 04:06:11.326069 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:06:12.350137 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57082. Sep 15 04:06:28.065563 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-9cc18a55-3c37-4d83-ad5d-52d404b703e6 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 04:06:28.066058 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9cc18a55-3c37-4d83-ad5d-52d404b703e6 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:06:28.066513 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9cc18a55-3c37-4d83-ad5d-52d404b703e6 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:06:28.305327 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-9cc18a55-3c37-4d83-ad5d-52d404b703e6 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: 3c57b46c-45bb-476e-9ebe-70fdce92dbf0] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101396) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 04:06:28.759268 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-9cc18a55-3c37-4d83-ad5d-52d404b703e6 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Created allocations for migration 23531ad4-902f-4097-bd74-99936f722a63 on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 04:06:28.960003 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:06:29.115100 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-9cc18a55-3c37-4d83-ad5d-52d404b703e6 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: 3c57b46c-45bb-476e-9ebe-70fdce92dbf0] Calling prep_resize with selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"7790447f-ae2c-4619-9754-640c71ce9599": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7790447f-ae2c-4619-9754-640c71ce9599"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=7790447f-ae2c-4619-9754-640c71ce9599,limits=SchedulerLimits,nodename='chh1-809057-1',service_host='chh1-809057-1')] {{(pid=101396) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 04:06:29.976223 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57160. Sep 15 04:06:35.408099 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:06:36.424847 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57180. Sep 15 04:06:41.444350 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:06:45.962414 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:06:48.002543 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:06:49.116602 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:06:49.134357 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:06:49.134764 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:06:49.251846 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:06:49.252250 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:06:49.253006 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:06:49.253399 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:06:49.267511 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Getting quotas for project 2e066d3bac624f17a86c0749a173a3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:06:49.272383 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Getting quotas for user 738fb8dbf36944c6b8e3a28d085a28f1 and project 2e066d3bac624f17a86c0749a173a3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:06:49.282497 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: db1879b7-706e-409c-9ebc-2ef1683a7cf2] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:06:49.283369 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:06:49.283797 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:06:49.328056 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: db1879b7-706e-409c-9ebc-2ef1683a7cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:06:49.329195 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:06:49.329600 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:06:49.501164 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:06:49.501582 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-4ec1a7e8-9323-4f83-9774-e4029326fef5 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:07:18.038386 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:08:48.430808 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:08:49.446523 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57508. Sep 15 04:08:57.342818 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:08:58.359371 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57526. Sep 15 04:09:12.344287 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:09:13.366769 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57562. Sep 15 04:09:14.512151 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:09:15.534198 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57568. Sep 15 04:09:29.978834 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:09:30.998240 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57606. Sep 15 04:09:34.299544 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-da7706ba-9e92-4cf6-9d80-398498f03d61 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 04:09:34.300120 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da7706ba-9e92-4cf6-9d80-398498f03d61 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:09:34.300497 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-da7706ba-9e92-4cf6-9d80-398498f03d61 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:09:34.552205 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-da7706ba-9e92-4cf6-9d80-398498f03d61 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: db1879b7-706e-409c-9ebc-2ef1683a7cf2] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101395) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 04:09:34.980792 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-da7706ba-9e92-4cf6-9d80-398498f03d61 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Created allocations for migration 40dedebb-4b89-443a-be32-76c9673ec60f on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 04:09:35.374576 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-da7706ba-9e92-4cf6-9d80-398498f03d61 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: db1879b7-706e-409c-9ebc-2ef1683a7cf2] Calling prep_resize with selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"7790447f-ae2c-4619-9754-640c71ce9599": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7790447f-ae2c-4619-9754-640c71ce9599"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=7790447f-ae2c-4619-9754-640c71ce9599,limits=SchedulerLimits,nodename='chh1-809057-1',service_host='chh1-809057-1')] {{(pid=101395) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 04:09:36.425632 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:09:37.442390 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57660. Sep 15 04:10:01.462318 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:10:15.575977 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:10:15.594968 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:10:15.595574 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:10:15.699478 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:10:15.699886 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:10:15.700667 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:10:15.701314 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:10:15.720444 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Getting quotas for project 2e066d3bac624f17a86c0749a173a3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:10:15.725771 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Getting quotas for user 738fb8dbf36944c6b8e3a28d085a28f1 and project 2e066d3bac624f17a86c0749a173a3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:10:15.736458 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: 47dee0d1-95b5-4b82-ad4b-0d261f49a772] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:10:15.737319 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:10:15.737788 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:10:15.791394 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: 47dee0d1-95b5-4b82-ad4b-0d261f49a772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:10:15.792663 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:10:15.793073 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:10:16.035952 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:10:16.036353 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b6c6f7ba-41ef-4d48-a96a-eb6f04486598 tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:10:38.055283 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:11:45.997550 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:11:48.024446 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:11:58.360396 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:11:59.376599 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58018. Sep 15 04:12:13.361802 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:12:14.382084 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58052. Sep 15 04:12:15.530006 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:12:16.552097 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58058. Sep 15 04:12:30.997171 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:12:32.012641 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58090. Sep 15 04:12:37.443784 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:12:38.459767 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58104. Sep 15 04:12:49.448777 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:12:50.464888 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58130. Sep 15 04:13:12.587936 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-f94c7084-121f-4c9d-bbe7-a4543b09ea2e tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 04:13:12.588431 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f94c7084-121f-4c9d-bbe7-a4543b09ea2e tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:13:12.588839 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f94c7084-121f-4c9d-bbe7-a4543b09ea2e tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:13:12.786190 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-f94c7084-121f-4c9d-bbe7-a4543b09ea2e tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: 47dee0d1-95b5-4b82-ad4b-0d261f49a772] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101395) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 04:13:13.303599 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-f94c7084-121f-4c9d-bbe7-a4543b09ea2e tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] Created allocations for migration e0969439-4b05-4c26-8d77-929b80282d2a on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101395) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 04:13:13.626931 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.tasks.migrate [None req-f94c7084-121f-4c9d-bbe7-a4543b09ea2e tempest-ServerActionsTestJSON-215558658 tempest-ServerActionsTestJSON-215558658-project] [instance: 47dee0d1-95b5-4b82-ad4b-0d261f49a772] Calling prep_resize with selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"7790447f-ae2c-4619-9754-640c71ce9599": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7790447f-ae2c-4619-9754-640c71ce9599"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=7790447f-ae2c-4619-9754-640c71ce9599,limits=SchedulerLimits,nodename='chh1-809057-1',service_host='chh1-809057-1')] {{(pid=101395) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 04:13:21.478171 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:13:58.071540 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:14:28.516375 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:14:29.532216 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58488. Sep 15 04:14:30.027244 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Took 1.52 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:14:30.046225 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:30.046631 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:30.209006 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:30.209320 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:30.210048 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:30.210442 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:30.225646 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Getting quotas for project fa17c6d8640944ada651c1aac93326bc. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:14:30.230123 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Getting quotas for user e1154be5e18745e1abd210714e8a50a2 and project fa17c6d8640944ada651c1aac93326bc. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:14:30.240563 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] [instance: 8d66fdff-ec48-450a-b39e-67f48638ae84] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:14:30.241450 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:30.241859 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:30.300849 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] [instance: 8d66fdff-ec48-450a-b39e-67f48638ae84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:14:30.302214 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:30.302628 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:30.509098 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:30.509425 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:30.518431 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] [597b04df-2609-4fb0-9478-82263fb6ff73] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:14:31.533517 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-b455590e-40f9-4a8a-bff2-fca668a4e1d3 tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] [597b04df-2609-4fb0-9478-82263fb6ff73] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58502. Sep 15 04:14:43.366991 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:14:43.385708 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:43.386114 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:43.487914 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:43.488315 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:43.489072 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:43.490196 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:43.504206 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Getting quotas for project fa17c6d8640944ada651c1aac93326bc. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:14:43.509283 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Getting quotas for user e1154be5e18745e1abd210714e8a50a2 and project fa17c6d8640944ada651c1aac93326bc. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:14:43.519883 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] [instance: eca2f2f6-7237-461a-8057-54f180c3681a] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:14:43.522572 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:43.522572 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:43.613008 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] [instance: eca2f2f6-7237-461a-8057-54f180c3681a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:14:43.614202 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:43.617888 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:43.822404 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:43.822811 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-bef773d5-54e6-49b2-8adb-8848ec5b62cd tempest-ServersNegativeTestJSON-743349438 tempest-ServersNegativeTestJSON-743349438-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:59.377684 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:15:00.393164 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58624. Sep 15 04:15:38.461096 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:15:39.479231 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58832. Sep 15 04:15:45.066247 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:15:45.095696 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:15:45.096422 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:15:45.309046 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:15:45.309726 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:15:45.310719 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:15:45.311355 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:15:45.326732 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Getting quotas for project fe40222bb2ec4a2fa106af3b5db32068. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:15:45.332155 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Getting quotas for user 98af4cf8b63d463cb329678800cd8169 and project fe40222bb2ec4a2fa106af3b5db32068. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:15:45.350381 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] [instance: 1b8fc391-cbe4-4a42-a51b-812bd567e8c8] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:15:45.351511 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:15:45.352021 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:15:45.434766 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] [instance: 1b8fc391-cbe4-4a42-a51b-812bd567e8c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:15:45.436064 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:15:45.436469 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:15:45.674068 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:15:45.674411 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-7a7ab45b-e735-49ba-bd51-54bb098e4a84 tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:16:24.791844 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:16:24.810792 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:16:24.811199 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:16:24.957559 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:16:24.957974 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:16:24.958697 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:16:24.959081 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:16:24.973064 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Getting quotas for project fe40222bb2ec4a2fa106af3b5db32068. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:16:24.977487 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Getting quotas for user 98af4cf8b63d463cb329678800cd8169 and project fe40222bb2ec4a2fa106af3b5db32068. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:16:24.987756 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] [instance: f2845b29-cdf0-45c5-ad12-fbd368125908] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:16:24.988659 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:16:24.989060 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:16:25.056334 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] [instance: f2845b29-cdf0-45c5-ad12-fbd368125908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:16:25.057511 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:16:25.057909 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:16:25.314743 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:16:25.315059 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6a999740-d7ef-4811-b596-49386362e99a tempest-TestEncryptedCinderVolumes-50094131 tempest-TestEncryptedCinderVolumes-50094131-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:16:41.494252 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:17:18.088848 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:17:36.190735 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:17:36.210113 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:17:36.211125 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:17:36.510465 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:17:36.510980 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:17:36.511883 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:17:36.512279 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:17:36.528583 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Getting quotas for project 2e49d95a9dd44a0cb5baaa4f471d2a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:17:36.533039 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Getting quotas for user 6044c4fe8b994c3895a8f27cf5746f33 and project 2e49d95a9dd44a0cb5baaa4f471d2a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:17:36.544154 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] [instance: 95fb52df-8d17-48b7-bf82-304f2083535f] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:17:36.546224 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:17:36.546224 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:17:36.602877 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] [instance: 95fb52df-8d17-48b7-bf82-304f2083535f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27d9d46f-61e9-40f3-8a9e-6ef4bc4c3b35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:17:36.604172 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:17:36.604576 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:17:36.781682 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:17:36.782009 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-04491c07-032e-4033-9040-23edf0ccc54e tempest-TestMinimumBasicScenario-1304506334 tempest-TestMinimumBasicScenario-1304506334-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:18:00.394678 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:18:01.410824 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59398. Sep 15 04:18:32.016947 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:18:33.032668 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59500. Sep 15 04:18:39.479707 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:18:40.496188 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59504. Sep 15 04:19:14.383862 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:19:15.405483 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59534. Sep 15 04:19:50.469895 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:19:51.486326 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59562. Sep 15 04:20:01.510549 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:20:16.552293 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:20:17.576904 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59594. Sep 15 04:20:38.106212 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:20:53.212789 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [5cf8a213-6374-470f-8d38-84ee6ca5eb85] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:20:54.227354 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [5cf8a213-6374-470f-8d38-84ee6ca5eb85] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59818. Sep 15 04:20:54.864030 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Took 1.66 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:20:54.888946 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:54.889346 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:55.087407 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:55.087994 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:55.088923 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:55.089319 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:55.108202 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:20:55.113360 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for user b4a2991336084d698b044362b02d4972 and project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:20:55.124938 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 153ac9c4-1ca5-4fdf-bf4e-42d6ddb63ed6] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:20:55.125878 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:55.126279 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:55.196729 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 153ac9c4-1ca5-4fdf-bf4e-42d6ddb63ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:20:55.198029 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:55.198434 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:55.444247 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:55.444815 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:55.454626 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [5bfeb9e5-7473-4321-9341-e0d9abd92894] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:20:56.471263 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [None req-062bbe78-92b8-456e-a771-282628b4af83 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [5bfeb9e5-7473-4321-9341-e0d9abd92894] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59834. Sep 15 04:21:01.412873 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:21:02.429772 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59850. Sep 15 04:21:40.497571 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:21:41.513484 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59882. Sep 15 04:22:34.592976 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:22:35.609794 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60014. Sep 15 04:22:38.067681 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Took 3.48 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:22:38.085862 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:38.086263 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:38.190850 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:38.191231 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:38.192013 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:38.192406 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:38.207183 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:22:38.211751 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for user b4a2991336084d698b044362b02d4972 and project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:22:38.222943 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: f7ea3ac8-b4ae-427f-bbb7-68c45fcc9d1f] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:22:38.223885 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:38.224287 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:38.289621 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: f7ea3ac8-b4ae-427f-bbb7-68c45fcc9d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:22:38.291182 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:38.291615 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:38.520405 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:38.520728 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:38.530573 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [597b04df-2609-4fb0-9478-82263fb6ff73] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:22:39.546579 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-206dd9f1-e760-4279-aa64-b70fc838d9c8 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [597b04df-2609-4fb0-9478-82263fb6ff73] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60038. Sep 15 04:23:15.402449 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:23:16.423268 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60082. Sep 15 04:23:21.527016 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:23:33.036026 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:23:34.051227 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60096. Sep 15 04:23:58.123256 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:24:02.430503 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:24:03.447308 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60130. Sep 15 04:24:41.514679 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:24:42.531135 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60152. Sep 15 04:24:51.489954 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:24:52.506727 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60166. Sep 15 04:25:17.572867 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:25:18.597051 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60208. Sep 15 04:25:30.659594 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:25:30.679888 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.680434 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.799711 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.800118 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.804003 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.804003 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.818346 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:25:30.823465 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for user b4a2991336084d698b044362b02d4972 and project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:25:30.835578 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 694e063c-ede0-42b1-a46d-da74455e7c2a] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:25:30.836926 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.836926 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.912792 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 694e063c-ede0-42b1-a46d-da74455e7c2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:25:30.912792 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.912792 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:31.197045 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:31.197987 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-69a4e0c9-732d-4c5a-8ab8-7bac782939e3 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:41.542988 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:27:03.449020 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:27:04.121164 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-9bad5c81-7b79-47a7-a7c2-2665b69672b5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method migrate_server {{(pid=101396) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 04:27:04.121649 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9bad5c81-7b79-47a7-a7c2-2665b69672b5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:04.122054 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-9bad5c81-7b79-47a7-a7c2-2665b69672b5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:04.355833 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-9bad5c81-7b79-47a7-a7c2-2665b69672b5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 694e063c-ede0-42b1-a46d-da74455e7c2a] Restricting to cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) while migrating {{(pid=101396) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Sep 15 04:27:04.466966 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60368. Sep 15 04:27:04.819369 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-9bad5c81-7b79-47a7-a7c2-2665b69672b5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Created allocations for migration 239626fc-0ac6-4ed3-b381-87ad1ef8474f on 7790447f-ae2c-4619-9754-640c71ce9599 {{(pid=101396) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Sep 15 04:27:05.124833 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.tasks.migrate [None req-9bad5c81-7b79-47a7-a7c2-2665b69672b5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 694e063c-ede0-42b1-a46d-da74455e7c2a] Calling prep_resize with selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [Selection(allocation_request='{"allocations": {"7790447f-ae2c-4619-9754-640c71ce9599": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7790447f-ae2c-4619-9754-640c71ce9599"]}}',allocation_request_version='1.36',availability_zone='nova',cell_uuid=57101796-6279-447c-b7ae-3a6223f12f96,compute_node_uuid=7790447f-ae2c-4619-9754-640c71ce9599,limits=SchedulerLimits,nodename='chh1-809057-1',service_host='chh1-809057-1')] {{(pid=101396) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:320}} Sep 15 04:27:18.139714 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:27:34.053857 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:27:35.069905 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60448. Sep 15 04:27:42.532432 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:27:43.548242 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60450. Sep 15 04:28:16.422765 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:28:17.445307 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60482. Sep 15 04:28:26.027227 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:28:28.053404 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:28:31.381637 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:28:31.404747 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.405147 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.514146 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.516696 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.517723 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.518123 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.543149 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:28:31.548597 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for user b4a2991336084d698b044362b02d4972 and project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:28:31.563912 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 54af5c56-96e8-4d40-b712-8b89b3d4d4fa] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:28:31.564705 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.565106 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.660559 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 54af5c56-96e8-4d40-b712-8b89b3d4d4fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:28:31.662530 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.662948 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.881681 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.882602 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-b584abc7-f6a6-40ba-9e4c-2398350f47c5 tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:01.559843 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:30:04.466578 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:30:05.482180 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60656. Sep 15 04:30:35.070993 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:30:36.087650 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60694. Sep 15 04:30:38.155668 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:30:43.549598 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:30:44.564977 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60700. Sep 15 04:30:52.510796 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:30:53.526337 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60708. Sep 15 04:31:17.441946 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:31:18.464284 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60736. Sep 15 04:31:18.592790 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:31:19.615116 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60742. Sep 15 04:31:37.084842 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [5cf8a213-6374-470f-8d38-84ee6ca5eb85] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:31:38.101599 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [5cf8a213-6374-470f-8d38-84ee6ca5eb85] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60820. Sep 15 04:31:38.562375 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Took 1.48 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:31:38.586271 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:38.586675 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:38.681143 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:38.681522 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:38.682231 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:38.682616 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:38.696828 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:31:38.701100 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Getting quotas for user b4a2991336084d698b044362b02d4972 and project 1c7d461535414c13af11899c54bc1a93. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:31:38.711289 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 6330aa48-ff94-4fe7-b1a7-450d23c7e151] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:31:38.712191 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:38.712583 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:38.771155 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [instance: 6330aa48-ff94-4fe7-b1a7-450d23c7e151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:31:38.772440 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:38.772826 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:39.001489 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:39.001900 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:39.011792 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [5bfeb9e5-7473-4321-9341-e0d9abd92894] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:31:40.026786 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [None req-7ed62b0f-f809-499e-ac66-0d9fc8661bca tempest-TestNetworkAdvancedServerOps-1891001014 tempest-TestNetworkAdvancedServerOps-1891001014-project] [5bfeb9e5-7473-4321-9341-e0d9abd92894] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60836. Sep 15 04:33:05.483811 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:33:06.501720 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60902. Sep 15 04:33:21.576512 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:33:40.727140 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:33:41.742878 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32846. Sep 15 04:33:42.271158 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Took 1.55 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:33:42.291832 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:33:42.292227 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:33:42.447397 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:33:42.447808 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:33:42.448542 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:33:42.448938 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:33:42.463192 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Getting quotas for project 18315e2d5562429d979f703ad63f8502. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:33:42.467691 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Getting quotas for user d3ff8d67efa44323a6a17e4d481fb244 and project 18315e2d5562429d979f703ad63f8502. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:33:42.478821 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [instance: 7a81b8d6-f261-4ea6-9162-f31ea9348b0b] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:33:42.479753 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:33:42.480154 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:33:42.534516 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [instance: 7a81b8d6-f261-4ea6-9162-f31ea9348b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:33:42.535682 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:33:42.536079 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:33:42.736039 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:33:42.736449 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:33:42.746307 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [597b04df-2609-4fb0-9478-82263fb6ff73] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:33:43.761037 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-5bcb80f7-f000-48e7-b5af-024fc9a6b878 tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [597b04df-2609-4fb0-9478-82263fb6ff73] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32866. Sep 15 04:33:44.566057 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:33:45.583603 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32872. Sep 15 04:33:58.171039 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:34:18.458917 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:34:19.481336 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32922. Sep 15 04:34:36.089967 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:34:37.106199 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32928. Sep 15 04:35:53.529884 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:35:54.569190 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32948. Sep 15 04:36:06.501678 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:36:07.517044 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32952. Sep 15 04:36:19.612306 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:36:20.633496 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32956. Sep 15 04:36:41.594262 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:36:45.583760 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:36:46.048411 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:36:46.600396 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33076. Sep 15 04:36:48.076606 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:36:57.956832 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a2e52fb1-dbc1-486c-bfc1-982444d25e7f tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method unshelve_instance {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 04:36:57.957367 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a2e52fb1-dbc1-486c-bfc1-982444d25e7f tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:36:57.957698 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-a2e52fb1-dbc1-486c-bfc1-982444d25e7f tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:36:58.390630 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a2e52fb1-dbc1-486c-bfc1-982444d25e7f tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [instance: 7a81b8d6-f261-4ea6-9162-f31ea9348b0b] Requesting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) during scheduling {{(pid=101395) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:927}} Sep 15 04:37:00.804265 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-a2e52fb1-dbc1-486c-bfc1-982444d25e7f tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Took 2.41 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:37:00.812274 chdv-809057-1 nova-conductor[101395]: DEBUG nova.objects.instance [None req-a2e52fb1-dbc1-486c-bfc1-982444d25e7f tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lazy-loading 'flavor' on Instance uuid 7a81b8d6-f261-4ea6-9162-f31ea9348b0b {{(pid=101395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:37:18.190289 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:38:42.433613 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:38:44.050547 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:38:54.570866 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:38:55.587571 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33290. Sep 15 04:39:07.518733 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:39:08.535594 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33330. Sep 15 04:39:19.477915 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:39:20.504611 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33444. Sep 15 04:39:20.629963 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:39:21.653657 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33456. Sep 15 04:39:32.120326 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:39:32.139424 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:39:32.139817 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:39:32.245362 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:39:32.245758 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:39:32.246527 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:39:32.246993 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:39:32.264791 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Getting quotas for project 18315e2d5562429d979f703ad63f8502. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:39:32.269131 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Getting quotas for user d3ff8d67efa44323a6a17e4d481fb244 and project 18315e2d5562429d979f703ad63f8502. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:39:32.279803 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [instance: f37093c3-cc09-44b4-8cef-ca9d0575898f] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:39:32.280676 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:39:32.281068 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:39:32.337632 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [instance: f37093c3-cc09-44b4-8cef-ca9d0575898f] block_device_mapping [BlockDeviceMapping(attachment_id=3525d2d8-3b99-47b5-80d4-0d8ee20c369e,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39433d8f-6aa1-4aab-bb9a-b647afb35a53',volume_size=1,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:39:32.338802 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:39:32.339195 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:39:32.580780 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:39:32.581099 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-f71f0697-47a3-49ec-94af-74179891371b tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:39:46.601590 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:39:47.617989 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33552. Sep 15 04:40:01.612576 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:40:38.207231 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:41:37.111839 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:41:38.127908 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33614. Sep 15 04:41:46.067505 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:41:48.102906 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:41:55.589317 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:41:56.605499 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33630. Sep 15 04:42:02.450037 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:42:04.067160 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:42:08.535708 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:42:09.552667 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33644. Sep 15 04:42:20.497853 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:42:21.519211 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33652. Sep 15 04:42:21.646785 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:42:22.668420 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33666. Sep 15 04:42:37.788472 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6d402670-0131-490f-9df8-3acc7e7596de tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Targeting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) for conductor method unshelve_instance {{(pid=101395) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Sep 15 04:42:37.788961 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d402670-0131-490f-9df8-3acc7e7596de tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:42:37.789325 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-6d402670-0131-490f-9df8-3acc7e7596de tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:42:37.966568 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6d402670-0131-490f-9df8-3acc7e7596de tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] [instance: f37093c3-cc09-44b4-8cef-ca9d0575898f] Requesting cell 57101796-6279-447c-b7ae-3a6223f12f96(cell1) during scheduling {{(pid=101395) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:927}} Sep 15 04:42:38.300502 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-6d402670-0131-490f-9df8-3acc7e7596de tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:42:38.308587 chdv-809057-1 nova-conductor[101395]: DEBUG nova.objects.instance [None req-6d402670-0131-490f-9df8-3acc7e7596de tempest-TestShelveInstance-203424443 tempest-TestShelveInstance-203424443-project] Lazy-loading 'flavor' on Instance uuid f37093c3-cc09-44b4-8cef-ca9d0575898f {{(pid=101395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:42:47.619545 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:42:48.636202 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33750. Sep 15 04:43:21.630108 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:43:58.225096 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:44:56.607507 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:44:57.627993 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33914. Sep 15 04:45:06.084239 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:45:08.119728 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:45:09.554768 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:45:10.225871 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:45:10.571120 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33990. Sep 15 04:45:11.241860 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [1af38e0d-e12a-4414-8ee0-b63e3f28221c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33992. Sep 15 04:45:11.782661 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Took 1.56 seconds to select destinations for 1 instance(s). {{(pid=101396) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:45:11.802380 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:45:11.802780 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:45:12.088277 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:45:12.088675 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:45:12.089419 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:45:12.089805 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:45:12.104765 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Getting quotas for project c4c67d727aed4037bca42805dd82b2d9. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:45:12.109801 chdv-809057-1 nova-conductor[101396]: DEBUG nova.quota [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Getting quotas for user 9db283b0dd524d30aa45f2ee3305c369 and project c4c67d727aed4037bca42805dd82b2d9. Resources: {'instances', 'ram', 'cores'} {{(pid=101396) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:45:12.120108 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [instance: 973589a1-284e-4467-ac55-b55b5453d251] Selected host: chh1-809057-1; Selected node: chh1-809057-1; Alternates: [('chh2-809057-1', 'chh2-809057-1')] {{(pid=101396) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:45:12.120982 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:45:12.121378 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:45:12.175585 chdv-809057-1 nova-conductor[101396]: DEBUG nova.conductor.manager [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [instance: 973589a1-284e-4467-ac55-b55b5453d251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31f7ee7f-ad3d-4c1d-9a83-b4784bfb9639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101396) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:45:12.176699 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:45:12.177097 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:45:12.383057 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:45:12.383708 chdv-809057-1 nova-conductor[101396]: DEBUG oslo_concurrency.lockutils [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:45:12.393514 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [597b04df-2609-4fb0-9478-82263fb6ff73] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:45:13.408987 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [None req-4c889e2b-2016-4179-a131-c74676e83274 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [597b04df-2609-4fb0-9478-82263fb6ff73] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34008. Sep 15 04:45:21.515028 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:45:22.536426 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34034. Sep 15 04:45:38.129970 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:45:39.146031 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34060. Sep 15 04:45:48.636753 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:45:49.652546 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34066. Sep 15 04:46:41.648314 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:47:18.241249 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:47:22.665910 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:47:23.686729 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34092. Sep 15 04:47:57.627858 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:47:58.644078 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34142. Sep 15 04:48:10.571630 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:48:11.588860 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34248. Sep 15 04:48:14.284790 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [5cf8a213-6374-470f-8d38-84ee6ca5eb85] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:48:15.299671 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [5cf8a213-6374-470f-8d38-84ee6ca5eb85] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34292. Sep 15 04:48:15.666964 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Took 1.39 seconds to select destinations for 1 instance(s). {{(pid=101395) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:909}} Sep 15 04:48:15.686114 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:48:15.686525 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:48:15.841439 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:48:15.841781 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:48:15.842517 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:48:15.842899 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:48:15.858882 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Getting quotas for project c4c67d727aed4037bca42805dd82b2d9. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:48:15.863279 chdv-809057-1 nova-conductor[101395]: DEBUG nova.quota [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Getting quotas for user 9db283b0dd524d30aa45f2ee3305c369 and project c4c67d727aed4037bca42805dd82b2d9. Resources: {'instances', 'ram', 'cores'} {{(pid=101395) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:48:15.874013 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [instance: 27fdee60-9e30-43e8-b477-35920e98b210] Selected host: chh2-809057-1; Selected node: chh2-809057-1; Alternates: [('chh1-809057-1', 'chh1-809057-1')] {{(pid=101395) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1654}} Sep 15 04:48:15.874935 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:48:15.875325 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:48:15.940773 chdv-809057-1 nova-conductor[101395]: DEBUG nova.conductor.manager [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [instance: 27fdee60-9e30-43e8-b477-35920e98b210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0dc8c41c-5832-4342-93f4-e8eb9797bf04',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101395) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1398}} Sep 15 04:48:15.941955 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:48:15.942350 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:48:16.102184 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:48:16.102587 chdv-809057-1 nova-conductor[101395]: DEBUG oslo_concurrency.lockutils [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] Lock "57101796-6279-447c-b7ae-3a6223f12f96" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:48:16.114582 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [5bfeb9e5-7473-4321-9341-e0d9abd92894] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:48:17.125879 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [None req-abd38b9f-7c5a-4581-85ee-9a43d2ea64d2 tempest-TestSnapshotPattern-1619248636 tempest-TestSnapshotPattern-1619248636-project] [5bfeb9e5-7473-4321-9341-e0d9abd92894] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34310. Sep 15 04:48:49.654578 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:48:50.669387 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34398. Sep 15 04:50:01.665742 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:50:22.471124 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:50:22.533859 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:50:23.554648 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34440. Sep 15 04:50:23.682839 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:50:24.088151 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:50:24.704434 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34444. Sep 15 04:50:38.257705 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:50:39.148813 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:50:40.166735 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34470. Sep 15 04:50:58.645862 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:50:59.663454 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34650. Sep 15 04:51:11.589751 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:51:12.607112 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34740. Sep 15 04:51:50.670653 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:51:51.687206 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34776. Sep 15 04:53:21.682436 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:53:23.550756 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:53:24.572940 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34794. Sep 15 04:53:24.700838 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:53:25.722904 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34796. Sep 15 04:53:26.111287 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:53:28.141237 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:53:40.165998 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:53:41.183470 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34802. Sep 15 04:53:42.487725 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:53:44.104352 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:53:58.274021 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:53:59.664977 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:54:00.681352 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34822. Sep 15 04:54:12.608257 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:54:13.624277 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34834. Sep 15 04:54:51.687599 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:54:52.703774 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34844. Sep 15 04:56:24.568944 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:56:25.589740 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34866. Sep 15 04:56:25.718631 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:56:26.739364 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34868. Sep 15 04:56:41.183905 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:56:41.699884 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:56:42.199467 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34876. Sep 15 04:56:46.127446 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:56:48.158066 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:57:00.681641 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:57:01.698353 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34884. Sep 15 04:57:02.504336 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:57:04.120323 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:57:13.626119 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:57:14.644093 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [38a7fdd7-b933-4675-8c06-70cd511395ac] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34896. Sep 15 04:57:18.290297 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:57:52.704939 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:57:53.721521 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a1da177-6101-4109-864a-fd46ebf94b03] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34902. Sep 15 04:59:25.585784 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:59:26.610337 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c54e649-bf9c-4982-ae27-7f2a07afc7d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34922. Sep 15 04:59:26.735962 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:59:27.757447 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487d85-6d37-45c0-89fc-b3505d21545d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34924. Sep 15 04:59:42.200611 chdv-809057-1 nova-conductor[101395]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 04:59:43.216751 chdv-809057-1 nova-conductor[101395]: INFO oslo.messaging._drivers.impl_rabbit [-] [edfeb868-b484-4646-b327-8acc0e8c70be] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34926. Sep 15 05:00:01.699273 chdv-809057-1 nova-conductor[101396]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 05:00:01.716278 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 05:00:02.715577 chdv-809057-1 nova-conductor[101396]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfe5f72d-9c00-4041-95a3-0ffa3330abe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34934.